Experienced engineer handling big data with a proven track record in designing, implementing, and optimizing end-to-end ETL pipelines, data migration strategies, and data lakes for advanced analytics. Proficient in data transformation, cleaning, and enrichment techniques, I specialize in creating scalable PySpark applications to tackle complex data challenges. Leveraging my expertise in Python, SQL, and AWS tools, I have successfully delivered high-quality solutions while ensuring data integrity and performance. With a strong focus on automation and best practices, I have implemented CI/CD pipelines and utilized pytest for rigorous testing. Passionate about continuous improvement, I excel in performance tuning and optimization of PySpark applications to maximize efficiency and insights