Azure Data Engineer
Current• Led the design and implementation of scalable data pipelines using Azure Data Factory and Azure Databricks, reducing processing time by 40%.• Architected a data warehouse on Azure Synapse Analytics, enhancing query performance and reporting capabilities.• Developed automated ETL processes with Azure Data Factory, improving data reliability and reducing manual intervention.• Integrated and optimized data from various sources into Azure Data Lake for efficient querying and reporting.• Implemented data security and compliance measures on Azure, ensuring the protection of sensitive information.• Conducted performance tuning and optimization of data processing jobs on Azure to enhance speed and efficiency.• Collaborated with data scientists and analysts to understand data requirements and deliver optimized Azure-based data solutions.• Monitored and troubleshooted Azure-based data pipelines, ensuring seamless operation and minimizing downtime.• Provided training and mentorship to junior data engineers, focusing on Azure best practices and advanced techniques.• Presented findings and insights from Azure-based data analysis to stakeholders, aiding in strategic decision-making.• Designed and implemented CI/CD pipelines for deploying Azure-based data solutions, improving deployment efficiency and reducing errors.