Data Engineer
Current• Design and develop scalable, event-based ETL pipelines using Python, Stored Procedures, Lambda Functions, EventBridge, to extract, transform, and load structured (csv, json) and unstructured data (text) from vendor sources into data warehouse in MySQL, PostgreSQL, and SQL Server.• Generate and develop custom reports for client and internal requirements.• Optimize data workflows to improve data processing, SQL query performance.• Create and maintain ETL build pipelines in Jenkins and manage workflow and log via Spinnaker and Grafana.• Monitor and troubleshoot data pipeline issues to ensure data availability and integrity.• Migrate legacy ETL workload to AWS using Terraform infrastructure.