Data Engineer Consultant
Current• Applied the BADIR framework to drive actionable insights and effi cient decision-making for clients, resulting in a 10X faster generation of insights and a 20X impact by focusing on top drivers.• Engineered a scalable, robust ETL pipeline using AWS Glue, Redshift, and Appfl ow, reducing costs by 75% and completing the project in 2 months, well ahead of the 3.5-month deadline.• Automated and orchestrated ETL processes with Managed Workfl ows for Apache Airfl ow (MWAA), implementing… Show more • Applied the BADIR framework to drive actionable insights and effi cient decision-making for clients, resulting in a 10X faster generation of insights and a 20X impact by focusing on top drivers.• Engineered a scalable, robust ETL pipeline using AWS Glue, Redshift, and Appfl ow, reducing costs by 75% and completing the project in 2 months, well ahead of the 3.5-month deadline.• Automated and orchestrated ETL processes with Managed Workfl ows for Apache Airfl ow (MWAA), implementing Slowly Changing Dimensions (SCDs), and creating a data warehouse in S3 buckets, achieving a 6-fold reduction in daily processing time.• Extracted and Integrated diverse data sources, via APIs, improving data accessibility and reducing data integration time.• Conducted in-depth revenue and trend analyses, enhancing data visualization and performing exploratory data analysis (EDA), driving a 20% increase in actionable insights through collaboration with data analysts. Show less