Director Data Engineering
CurrentDirected a team of employees and contractors, managing a budget, with a focus on data engineering, architecture, security, and analytics. Successfully created integrated data experiences across diverse business segments, including Consumer, Marketing, Digital, and core business functions. Directed the migration of hundreds of data sets to Azure Cloud, enhancing data accessibility, speed, and security for Analytics, Machine Learning and AI use cases. This initiative processed billions of records in batch & streaming and generated over $50M in business value.• Successfully built and delivered Azure Databricks Lakehouse data platform with Unity Catalog in short period for Consumer Office and Marketing by making data available for 90+ Web Sites and 200 + Qualtrics resulting in increase in consumer interaction by 5% and NPS score to 95%.• Successfully implemented Azure cloud projects with data ingestions from multiple sources, data enrichments, data transformations and data provision for Analytics, reporting, AI and Machine learning helping business build use cases to save time and money by making data available quickly with lean development techniques.• Implemented Infrastructure expenses saving practice by data cleaning and centralizing access control as per security guidance to remove redundant data storages resulting in 40% storage reduction and up to $2M savings.• Established best engineering practices in development, operations and testing leaning to 40% cost savings by building Automation and reusable code using Microsoft Copilot and ChatGPT.• Researched and implemented cutting-edge technologies including Azure Data Bricks Lake House, Delta Tables, Snowflake, PowerBI, and Tableau on the Azure cloud platform, enhancing data analytics and ML capabilities.• Established robust processes for Master Data Management, data governance, data security, data access management, and data protection, ensuring compliance with industry standards.
