Software Engineer
Current- Spearheaded the design and implementation of an efficient CI/CD pipeline for ETL processes, resulting in a 30% reduction in data processing time while seamlessly integrating over five automotive business systems. - Utilized Python, SQL, and Apache Spark to process over 500 GB of sales and production data monthly, increasing data delivery efficiency by 25%.- Built and maintained a centralized data warehouse on AWS Redshift, integrating 7+ automotive business sources and improving query performance by 40% through indexing and data partitioning.- Designed real-time streaming data pipelines using Apache Kafka, processing over 2 million records daily with 99.9% uptime.- Assisted business teams with data exploration, trend analysis, and creating detailed reports, enabling better decision-making for the clients & Stakeholders.- Partnered with data scientists and analysts to deliver data sets that reduced analysis turnaround time by 35%, enabling quicker decision-making for automotive production planning.- Optimized data workflows, ensuring efficient and timely data processing, reducing manual intervention by 80% using Airflow.- Developed Complex SQL Queries for clients with desired KPI logics for Procurement Planning and Contract Calculations.