𝐑𝐨𝐥𝐞𝐬 & 𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬:1. Worked as Azure Data Engineer to design and develop a metadata-driven architecture for efficient data ingestion, enhancing scalability and performance.2. Led the migration of multiple workflows from Hive to Spark, improving processing times and resource utilization.3. Developed end-to-end ETL pipelines for seamless data migration from disparate on-premises sources to Azure Databricks Delta Lake using Azure Data Factory.4. Optimized Azure Data Factory pipeline efficiency by 60% through strategic enhancements, including replacing notebook activities with Databricks notebook execution via REST API.

𝐑𝐨𝐥𝐞𝐬 & 𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬:1. Worked as Azure Data Engineer to design and implement data pipelines using Azure Data Factory to orchestrate and manage data movement and transformations.2. Upgraded existing application from single-tenant to multi-tenant, resulting in cost savings of $14,000 per day.3. Built scripts for migration of Delta Lake data between multiple Azure Databricks hive metastores using Unity catalog.4. Leveraged Azure Databricks for advanced data transformations and processing on large datasets within the pipelines.

𝐑𝐨𝐥𝐞𝐬 & 𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬:1. Worked as Azure Data Engineer to utilize azure data factory for ETL processes to migrate on-premises MySQL databases to Azure SQL Database.2. Developed reusable Databricks notebooks for data transformation and cleansing of sales and inventory data.3. Optimized Azure Data Factory pipelines to enable efficient incremental data loading for daily ETL operations.