Lead Data Engineer
CurrentAzure Data Solutions: Developed end-to-end data and analytics solutions using Azure Data Factory, ADLS Gen2, Databricks, and Synapse Analytics. These pipelines supported data ingestion, preparation, training, and model deployment for real-time analytics.Automation & Governance: Automated data workloads across Azure resources using Azure Functions and ensured data governance, security, and legal compliance within the architecture. Implemented data quality checks and audit trails to meet regulatory requirements.Power BI Dashboards: Designed and deployed interactive Power BI dashboards, providing real-time data visualization that enhanced decision-making across marketing and sales teams.Marketing Data Integration: Worked closely with marketing teams to integrate data from platforms like Google Marketing Platform and Salesforce MCI, optimizing data ingestion pipelines for comprehensive analytics.Real-time Data Processing: Leveraged Databricks to process large-scale data in real-time using Delta Lake, reducing query execution times by 30% and improving operational efficiency.Python & API Architecture: Developed Python-based APIs for seamless integration of marketing and operational data into the analytics framework, automating workflows and enhancing data accessibility.