• Managing data engineering tasks for ALDI’s promotional planning tool, utilizing predictive analytics to optimize product selection for upcoming promotional cycles and maximize revenue.• Expertly crafting ETL pipelines with Databricks and Spark, managed and orchestrated via Azure Data Factory, to streamline data processing.• Implementing comprehensive testing suites with PyTests and Great Expectations to ensure data integrity and pipeline reliability.• Enhancing and expanding our data model to support evolving business requirements and facilitate scalable solutions.• Managing high-volume data extraction and integration from diverse sources, including SAP systems, Excel files, and Spark.• Utilizing Jira and Confluence for effective team collaboration and agile project management, aligning with Scrum methodologies.• Ensuring the timely delivery of critical data to stakeholders, empowering them with timely insights for informed decision-making.• Successfully deployed our data product in Austria and Germany, with ongoing efforts to expand our market reach to the UK.

• Developed and managed comprehensive ETL pipelines for Afiniti's data warehouse utilizing PostgreSQL, MySQL, Python, and Airflow, ensuring seamless end-to-end automation.• Successfully deployed several Business Intelligence dashboards, enhancing client reporting for large accounts such as AT&T, Virgin Media, and Sky.• Collaborating with cross-functional teams to gather requirements, business logic, and mitigating blockers.• Designed sophisticated relational and dimensional data models to optimize the structural integrity of the company’s data warehouse.• Conducted detailed analyses and prepared insightful reports on client performance and revenue streams, informing strategic decisions by the company’s leadership.• Implemented robust data quality checks to guarantee the availability of accurate and reliable data for reporting.• Spearheaded communications and coordination for multiple migrations across databases, servers, and toolsets.• Pioneering a research and development initiative aimed at transitioning ETL processes from Talend to Apache Airflow, promising enhanced data processing efficiency and effective pipeline management.

• Executed comprehensive data engineering tasks including managing and monitoring pipelines and leveraging Databricks for data transformation.• Designed and deployed PowerBI dashboards, for reporting and showcasing metrics for ETL job monitoring.• Successfully deployed OwnCloud utilizing Docker and Kubernetes, with Elastic search integration.• Automating data ingestion from complex Excel files using Pandas in Python