Team Lead Manager
Current
San Francisco, California, United States
- Used AWS data pipeline for Data Extraction, Transformation and Loading from homogeneous or heterogeneous data sources and built various graphs for business decision-making using Python mat plot library.
- Understanding the requirements by interacting with business users and mapping them to design and implementing it following the AGILE Development methodology.
- Exploring with Spark to improve the performance and optimization of the existing algorithms in Hadoop using Spark context, Spark-SQL, postgreSQL, Data Frame, OpenShift, Talend, pair RDD's