- Migration of SAS/SQL ETL pipelines to PySpark using Databricks structured streaming. - Restructuring core pipeline into PySpark with efficient OOP structure and build unit tests.- Using Azure DevOps Pipelines integrated with Git to fully automate builds and releases.- Python used to parse SAS log files, creating networks of mermaid graphs which are then written to an interactive website auto-refreshed using HTML/Javascript.- Developed dynamic reports using Python, HTML and JavaScript to monitor and visualize the status and dataflow of batch jobs in the Big Data ETL pipeline.- Developed a data governance pipeline, delivering statistics on accuracy/completeness of business attributes/metrics and uploading from on-prem into the cloud.-Communicating with stakeholders to build new data models, fix data issues, add new business logic and produce daily reports.

- Completed a 3-month intensive training programme in SAS and other data engineering tools at Katalyze data- Obtained Base SAS certification and demonstrated proficiency in SAS Programming (Fundamental and Advanced), SAS Macro, and SAS SQL- Participated in Python and R bootcamps to enhance data analysis and visualization skills- Secured a 9-month placement as a data engineer at AXA UK, working on innovative data projects for the company

- Replenishing and organizing stock in a high foot traffic retail store.

- General computer literacy and tech knowledge required to answer questions confidently and solve customer problems.- Communication skills were developed through selling products; building solid rapport and extracting useful information from customers was vital in sales.