Lead Data Specialist
Current- Overseeing data engineering team operations, efficiently distributing tasks, providing constructive feedback, conducting performance reviews, and mentoring, resulting in high team satisfaction and skill development.- Collaborated to define the data team's strategy and conveyed the technology vision to executives, leading to a prioritisation of technology uplift, clear alignment with the organisational strategy, and further invitations to executive strategy events.- Architected and implemented a scalable data lake using Apache Iceberg, AWS S3, lifecycle policies, AWS Glue (PySpark), and Athena, migrating 120 ETL jobs to the cloud, enhancing capabilities and data value.- Designed solutions for disaster recovery, high availability, and scalability, leveraging cloud-native and serverless technologies such as AWS Backup, AWS Glue, Step Functions, Lambda, SQS, EventBridge, DynamoDB, resulting in scalable and fault-tolerant systems.- Spearheaded the creation of a customer churn ML model using AWS SageMaker, AWS Lambda, AWS SQS, and Docker, enhancing targeting effectiveness and driving personalised communications.- Championed the implementation of cloud management protocols using Terraform (IaC) and Azure DevOps pipelines (CICD), driving operational efficiencies and system consistency.- Implemented advanced security controls with AWS Lake Formation and IAM, established continuous monitoring using AWS SecurityHub, and client-managed encryption with AWS KMS, resulting in a high cybersecurity posture for the cloud environment.- Managed cloud budgets and implemented cost control measures, leveraging cloud cost management tools (AWS Cost Explorer, Budgets, CloudWatch), ensuring adherence to financial targets and enhancing system performance on AWS.