• Led the design and implementation of scalable data pipelines using Azure Data Factory and Azure Databricks, reducing processing time by 40%.• Architected a data warehouse on Azure Synapse Analytics, enhancing query performance and reporting capabilities.• Developed automated ETL processes with Azure Data Factory, improving data reliability and reducing manual intervention.• Integrated and optimized data from various sources into Azure Data Lake for efficient querying and reporting.• Implemented data security and compliance measures on Azure, ensuring the protection of sensitive information.• Conducted performance tuning and optimization of data processing jobs on Azure to enhance speed and efficiency.• Collaborated with data scientists and analysts to understand data requirements and deliver optimized Azure-based data solutions.• Monitored and troubleshooted Azure-based data pipelines, ensuring seamless operation and minimizing downtime.• Provided training and mentorship to junior data engineers, focusing on Azure best practices and advanced techniques.• Presented findings and insights from Azure-based data analysis to stakeholders, aiding in strategic decision-making.• Designed and implemented CI/CD pipelines for deploying Azure-based data solutions, improving deployment efficiency and reducing errors.

• Designed and maintained Azure-based data pipelines for ingesting, processing, and storing large datasets from various sources.• Utilized Azure Synapse Analytics and Azure Data Lake to build a scalable data lake, enabling efficient storage and retrieval of big data.• Optimized SQL queries and database performance on Azure SQL Database, leading to a 30% reduction in query execution times.• Automated ETL processes using Azure Data Factory, streamlining data workflows and improving accessibility.• Led the migration of on-premise data infrastructure to Azure cloud solutions, leveraging Azure Synapse Analytics for analytics.• Conducted performance tuning and optimization of ETL processes on Azure, enhancing efficiency and reducing latency.• Developed data integration solutions on Azure to combine data from different sources into a single cohesive dataset.• Collaborated with the DevOps team to implement CI/CD pipelines for Azure-based data solutions, improving deployment processes.• Implemented monitoring and alerting systems in Azure to proactively detect and address data pipeline issues.• Worked closely with data scientists to prepare datasets for machine learning models on Azure, improving model accuracy and performance.• Documented all Azure data pipeline processes and workflows, ensuring transparency, reproducibility, and adherence to best practices.