• Senior Data Engineer with 15+ years of experience designing, building, and managing complex data engineering pipelines using Azure Data Factory and Databricks.• Expertise in handling batch and near real-time data ingestion using Azure Service Bus, integrating structured, semi-structured, and unstructured data.• Extensive experience in managing and transforming data using PySpark, SparkSQL, and building pipelines for Bronze, Silver, and Gold data layers.• Adept in data governance, ensuring data quality and security through frameworks like RBAC, ACLs, and Azure Key Vault for credential management.• Proficient in building robust ETL pipelines using Azure Data Factory and Databricks, ensuring seamless data ingestion and transformation across diverse data sources.• Strong expertise in data storage solutions, particularly Azure Data Lake Storage Gen2, enabling efficient data organization and retrieval for analytics purposes.• Skilled in programming languages including Python, SQL, and Scala, with a focus on developing scalable data processing applications and analytics solutions.• Extensive experience in creating interactive dashboards and reports using Power BI and Tableau, delivering actionable insights to drive business strategies.• Proven track record of implementing CI/CD practices using Azure DevOps, GitHub Actions, and Terraform, promoting efficiency and collaboration within development teams.• Adept at establishing data governance frameworks and security protocols, ensuring compliance with industry standards and safeguarding sensitive information.• Proficient in data ingestion formats like Parquet, Avro, and JSON, optimizing data storage in ADLS Gen2 and enhancing performance.• Strong experience in monitoring pipelines using Azure Monitor, setting up alerts, and ensuring pipeline SLAs are met.• Skilled in implementing CI/CD pipelines using Azure DevOps, GitHub Actions, and Terraform to automate deployment and infrastructure management.• Expertise in Azure Cost Management, driving significant cost savings by optimizing cloud resource utilization.• Experienced in collaborating with cross-functional teams and stakeholders to deliver scalable and reliable data solutions that align with business goals.