Technical Lead
Current- Designed and implemented data-driven workflows with Azure Data Factory, orchestrating end-to-end integration, transformation, and loading processes, ensuring automation and reliability.
- Built scalable data pipelines with efficient logging mechanisms, prioritizing data integrity and enabling effective troubleshooting capabilities.
- Developed Data bricks notebooks for data reading, transformation, and writing to Data Lake, resulting in improved data reliability and performance.
- Excellent problem-solving skills, adaptability, and the ability to work in cross-functional teams to deliver data engineering solutions in Azure.
- Automate manual activities, like Incremental processing of the AAS Model and continuous deployment.
- Experienced in integrating Azure Data Factory with other Azure services, such as Azure Data Lake Storage, Azure SQL Database, and Azure Data Bricks, to create comprehensive data solutions and support advanced analytics.