Data Engineer | Big Data Specialist | ETL Expert | AWS & Apache Spark EnthusiastWith over 5 years of experience in the tech industry, I specialize in building and optimizing robust analytical data pipelines, leveraging cutting-edge big data technologies such as AWS and Apache Spark. I am passionate about creating scalable and efficient data workflows, and I bring deep expertise in end-to-end ETL processes, from extraction to transformation and loading, across a variety of data sources including flat files and relational databases.Key Skills & Expertise:✓ Data Pipeline Development & Maintenance: Expertise in designing, building, and maintaining data pipelines using AWS, Apache Spark, and other modern data technologies.✓ ETL Optimization: Proficient in tuning and optimizing Spark jobs and ETL processes for better performance, scalability, and reliability.✓ ETL Tools: Hands-on experience with tools like AWS Glue, PySpark, Airflow, Azure DevOps (VSTS), Jenkins, and Dataflow.✓ SQL & Data Validation: Strong proficiency in writing complex SQL queries for data validation, ensuring data accuracy and completeness post-transformation.✓ Testing & Quality Assurance: Skilled in designing and executing comprehensive test cases and plans to ensure the integrity of data throughout the ETL process.✓ Problem Solving & Troubleshooting: Experienced in diagnosing and resolving issues, collaborating with development teams to ensure high-quality data integration and flow.✓ Tools Knowledge: Familiar with Heartland, Postman, Rally, Qtest, WinSCP, Putty, and other software tools essential for data engineering and testing.I am passionate about driving data-driven decision-making through automation and the development of high-performing, scalable data systems. My goal is to continuously optimize processes, reduce bottlenecks, and ensure data integrity at every stage of the data pipeline.