Sai Chandra Email & Phone Number

United States

• Experience in building and architecting multiple Data pipelines, end to end ETL and ELT process for Data ingestion and transformation in GCP and coordinate task among the team.
• The roles include creating data pipelines from application databases to Data Lake and warehouse and create stream and batch data processing pipelines.
• Build data pipelines in airflow in GCP for ETL related jobs using different airflow operators.
• Created python scripts to ingest data from on-premise to GCS and built data pipelines using Apache Beam and Data Flow for data transformation from GCS to Big query
• Maintaining more than 16 PB, 300 nodes Cloudera's distribution Hadoop production and dev clusters. Perform daily health checks, work on alerts, and other related tasks.
• Created Hive databases, tables and queries for data analytics as and when needed, integrate them with data processing jobs, and drop them as a part of cleanup. Also working on maintaining HBase database used by other.

Dania, Florida, United States

• Worked on AWS Data pipeline to configure data loads from S3 to into Redshift.
• Using AWS Redshift, I Extracted, transformed and loaded data from various heterogeneous data sources and destinations
• Created Tables, Stored Procedures, and extracted data using T-SQL for business users whenever required.
• Performs data analysis and design, and creates and maintains large, complex logical and physical data models, and metadata repositories using ERWIN and MB MDR
• I have written shell script to trigger data Stage jobs.
• Assist service developers in finding relevant content in the existing reference models.

New York, United States

• Designed and Implemented Sharding and Indexing Strategies for MongoDB servers.
• Optimizing pig scripts, user interface analysis, performance tuning and analysis.
• Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting on the dashboard.
• Implemented the import and export of data using XML and SSIS.
• Involved in Planning, Defining and Designing data base using ER Studio on business requirement and provided documentation.
• Responsible for migration of application running on premise onto Azure cloud.

Hyderabad, Telangana, India

• Deployed Lambda and other dependencies into AWS to automate EMR Spin for Data Lake jobs
• Scheduled spark applications/Steps in AWS EMR cluster.
• Extensively used event-driven and scheduled AWS Lambda functions to trigger various AWS resources.
• Implemented advanced procedures like text analytics and processing using teh in-memory computing capabilities like Apache Spark written in Scala.
• Developed spark applications for performing large scale transformations and denormalization of relational datasets.
• Developed and executed a migration strategy to move Data Warehouse from SAP to AWS Redshift.

Hyderabad, Telangana, India

Involved in implementation of the project went through several phases namely: data set analysis, preprocessing data set, user-generated data extraction, and modeling.Participated in Data Acquisition with the Data Engineer team to extract historical and real-time data by using Sqoop, Pig, Flume, Hive, MapReduce, Land HDES.Wrote user-defined functions (UDFs).