Azure Data Engineer
CurrentOrchestrated seamless data flow using Azure Data Factory, ADLS Gen2, and Databricks with PySpark for scalable transformations.Mastered Data Flows and other Azure Data Factory features to optimize ETL processes, ensuring data cleansing, filtering, and aggregation for advanced business insights.Migrated and optimized legacy data warehouse to Snowflake on Azure, achieving 3x faster query performance and 40% reduction in data storage costs.Applied advanced performance tuning techniques in Azure Data Engineering, boosting query performance by 40% in Azure Databricks through proactive measures.Optimized data ingestion via historical, incremental, and full load pipelines, ensuring efficient data storage, accurate updates, and real-time responsiveness.Implemented Azure Event Hub for real-time data ingestion in retail, improving foot traffic monitoring, fraud detection, and operational agility.