-Built system design and architecture of data lake for payments, credits and decision making.– Developed data pipeline to load data to third-party SaaS Applications like Salesforce usingAWS Appflow.– Developed lambda functions to handle streaming data and offload it to AWS RDS.– Developed automation script for building Cloud formation stack and data validation whichreduced the workload of the development team by 25%.– Performed data extraction from various sources such as Oracle, SQL server, and ingested datainto AWS S3 bucket.– Worked on view creation as per the business logic using pyspark in AWS Glue.

-Developed ETL pipelines for processing more than 1 TB of daily data which allowed the full360-degree view of customers from product usage to back office transactions.– Transformed more than 50 ETL tables having complex logic which completed 40% of milestone.– Completed end-to-end data validation for 100+ tables.– Developed an enhanced automation script which reduced 25% the workload of the development team.– Owned UAT environment and tested more than 100+ tables.– Successfully deployed 3 milestones in production which helped the business team to go live.– Worked with various file formats such as parquet, CSV, tab and zip.

got trained in Python, Unix, SQL, MongoDB, and BIG data and completed assessments on the same.