# Senior data developerResponsible for coding data pipelines in Python (PySpark) to take inputs from Amazon S3 and PostgreSQL and carry out validation, standardisation, cleansing and other custom transformation steps.Created Apache Airflow DAGs to process data pipelines with EMR Serverless, triggered by Lambda function.Worked as part of an agile team with project tracking in Jira and regular code updates to Bitbucket source control.Developed a proof of concept solution to run data science models in the cloud on demand for clients, where the main Python processing engine was deployed in EKS using an MLFlow tracking server.# Senior platform support analystBuilt and maintained on premise data pipelines, written with Alteryx and Python, that generated some of Experian’s key marketing data products.Conducted troubleshooting and resolved problems on the live platform where the pipelines were processed.Designed and maintained a large SQL Server “permissions” database containing several billion name/address data records received from suppliers, bulk updated on a monthly basis.Designed and maintained a smaller transactional database that sat behind Experian’s customer-facing Consumer Information Portal website, which allows people to opt out of marketing.# GIS developerCreated our base mapping data from HERE data, adding our own classification schemes and theming the data.Processed street data and added speed classifications to produce drivetime networks.Maintained geographical lookup tables defining administrative and postal hierarchies.Processed quarterly Ordnance Survey updates, including MasterMap Topography and AddressPoint, releasing them to internal users.# Spatial analystWorked in a large team of analysts on a variety of projects, helping our clients to understand their customers, locate new stores and increase profits.Examples of projects included:- Creating simple demographic profiles and maps to aid retailers in targeting their customers.- Appending information to client datasets to enrich them.- Writing macros to produce large numbers of reports in batch.- Running gravity models to assess the impact of expanding a shopping centre.- Analysing sales figures to help clients locate a new store.