- Worked on achieving the 'AWS Designated Quicksight Specialized Partner' status for the company- Led the cost optimization assignment to reduce the cost on AWS services like Glue,S3, Athena etc.- Worked on ingesting the data from on-prem HDFS to GCS, Kafka to Bigquery using Cloud Composer & Dataproc

- Led the optimization, planning & execution of near-live data pipeline to cater black friday day sale which happens to be 6x the usual volume. Further, the implementation reduced the runtime of the process from 3.3 hrs to 20 mins- Executed a data ingestion assignment that involves creation of big data pipelines & storing the data in data lake using multiple AWS services like S3,Glue, Athena,Lambda,DynamoDB,Cloudwatch etc - Led an end-to-end project for building a Qliksense dashboard & its Databricks pipeline which effectively reduced the manual work that customer puts every quarter for creating manual PowerPoint presentations

- Led a team of 6 data engineers to support the data engineering maintenance, planning, monitoring, deployment & other activities - Provided multiple project proposals & estimations which further generated revenue for the organization- Played an Offshore SME role for a NextGen Analytics project involving data mining & data ingestion and further to build a competitive dashboard using Tableau, R & Python- Led an project to migrate the existing heavyweight shell script SQL queries to ETL pipelines which stopped the overload on the database source system - ETL developer responsible for data ingestion across heterogenous sources & targets using Informatica IICS, Snowflake etc

- Attended continuous training on various business intelligence tools & technologies like Python, Informatica, Tableau, SQL, Java etc- Development/Enhacement of straightforward ETL mappings and monitoring & performing health check for the existing production workflows