Onyx Research Data Platform:**Greenfield Project*** As a key member of the greenfield Onyx Research Data Platform initiative, I spearheaded the design and development of the self-service data pipelines - FastAPI-based solution, and RESTful microservices, prioritizing simplicity, performance, and scalability.**Key Contributions*** **Project Acceleration:** Created reusable GitHub templates and a UI-driven provisioning portal for self-service data pipelines, slashing project… Show more Onyx Research Data Platform:**Greenfield Project*** As a key member of the greenfield Onyx Research Data Platform initiative, I spearheaded the design and development of the self-service data pipelines - FastAPI-based solution, and RESTful microservices, prioritizing simplicity, performance, and scalability.**Key Contributions*** **Project Acceleration:** Created reusable GitHub templates and a UI-driven provisioning portal for self-service data pipelines, slashing project setup time from weeks to minutes.* **Standardization & Best Practices:** Developed Azure DevOps shared libraries for CI/CD (container bakery) and IaC (Terraform), enforcing consistent coding practices and streamlining releases.* **Security from the Start:** Integrated security scanning tools (Wiz, SonarQube, BlackDuck, Checkov, Binary Authorization) into the CI/CD workflow, proactively mitigating vulnerabilities within the Onyx Research Data Platform.* **Flexible Data Workflows:** Built a catalog of data pipeline templates (Cloud Workflow, Golang, Python, and more.) and custom pre-built containers, enabling rapid customization and scalable engineering workflows.* **Automated Updates:** Designed a template orchestration system to propagate updates from shared libraries to user projects, ensuring continuous alignment with standards and security patches.* **Scalable Infrastructure Blueprint:** Developed a robust Terraform infrastructure as code (IaC) blueprint, applying software engineering principles for scalability, modularity, testing, automation, and security.* **GCP Dynamic Workspace Orchestration:**Dynamic project and service orchestration solutions on GCP, ensuring resource optimization and cost efficiency.* **Cost Optimization:** Built an automated workflow monitoring and job cancellation system within Onyx, optimizing resource usage and minimizing unnecessary costs. Show less

**Service Mesh & CI/CD Enhancements*** Managed Istio deployment in GKE (Helm/Terraform)enabling secure and efficient microservice communication.* **Disaster Recovery:** Designed and implemented a disaster recovery strategy for Jenkins instances across the bank, defining RTO & RPO metrics to ensure service resilience and minimize downtime.**Compliance & Migration*** Ensured infrastructure compliance with Chef Inspec, promoting security and adherence.* Modernized… Show more **Service Mesh & CI/CD Enhancements*** Managed Istio deployment in GKE (Helm/Terraform)enabling secure and efficient microservice communication.* **Disaster Recovery:** Designed and implemented a disaster recovery strategy for Jenkins instances across the bank, defining RTO & RPO metrics to ensure service resilience and minimize downtime.**Compliance & Migration*** Ensured infrastructure compliance with Chef Inspec, promoting security and adherence.* Modernized container build pipelines through GCR to Harbour migration.**Infrastructure Automation & Webhook Solution*** **Terraform Expertise:** Developed multiple Terraform templates for various value streams, streamlining infrastructure provisioning and promoting consistency.* **Innovative Webhook Forwarding:** Designed, implemented, and delivered a Smee client solution, enabling secure triggering of Jenkins builds with webhooks behind firewalls. **Cloud Adoption & Fraud Detection Model Migration*** **Cross-Bank Integration:** Collaborated on Jenkins server integration for the cloud adoption team, facilitating the onboarding of multiple value streams within Lloyds Banking Group.* **Istio Onboarding:** Empowered the Mass affluent value stream to adopt provided Istio templates, accelerating their cloud modernization efforts.* **Fraud Detection Modernization:** Led and supported a critical initiative to migrate the bank's fraud detection model from IBM to GCP, resulting in a significant 60% reduction in operational costs. Developed a well-organized GitHub catalog for Kubeflow pipeline component containers, prioritizing versioning, security (via Aqua Scan), and semantic versioning. Skillfully converted community Kustomize manifests for various Kubeflow components into Helm chart templates, enabling streamlined utilization within the bank's infrastructure. Show less

AI-Powered 5G Network forecasting engine:* Containerized ML applications using Docker, establishing a robust CI/CD pipeline for streamlined builds and deployments to Google Container Registry (GCR).* Collaborated closely with data scientists to integrate the Kubernetes Pods Operator within Cloud Composer DAGs, enabling efficient orchestration of multiple containers in Kubernetes pods for model execution.* Proactively engaged with Google Cloud Build product teams to implement custom… Show more AI-Powered 5G Network forecasting engine:* Containerized ML applications using Docker, establishing a robust CI/CD pipeline for streamlined builds and deployments to Google Container Registry (GCR).* Collaborated closely with data scientists to integrate the Kubernetes Pods Operator within Cloud Composer DAGs, enabling efficient orchestration of multiple containers in Kubernetes pods for model execution.* Proactively engaged with Google Cloud Build product teams to implement custom workers with the VPCSC (preview) feature, ensuring Vodafone's stringent security requirements were met.* Implemented Google Cloud infrastructure as code (IaC), driving automation and consistency in deployments.**Impact:** Enabled ML engineers to iterate faster on model training, testing, and serving, leading to enhanced model deployment and feedback loops. Show less

Internal & Open-Source Contributions:* **Open-Source Impact:** Developed an Infrastructure as Code library for the public Terraform Registry. Ensured code reusability, battle-tested reliability (with Terratest), and streamlined deployments within Datatonic and the broader community. * **Modular Design for Efficiency:** Created reusable Terraform modules, maximizing internal efficiency and adaptability for client projects, with the potential for broader open-source adoption.*… Show more Internal & Open-Source Contributions:* **Open-Source Impact:** Developed an Infrastructure as Code library for the public Terraform Registry. Ensured code reusability, battle-tested reliability (with Terratest), and streamlined deployments within Datatonic and the broader community. * **Modular Design for Efficiency:** Created reusable Terraform modules, maximizing internal efficiency and adaptability for client projects, with the potential for broader open-source adoption.* **Streamlined Onboarding:** Built reusable Terraform templates to accelerate new data team onboarding within Datatonic, also fostering potential adoption by the open-source community.* **CI/CD Enabler:** Deployed a group GitLab runner in GKE, empowering cross-team CI/CD pipeline development and execution within Datatonic.* **Strategic Sales Partner:** Collaborated on pre-sale engagements, defining project scopes to support sales team success during commercial negotiations.* **Knowledge Sharing Leader:** Presented Terraform best practices during Engineering assemblies, fostering expertise across the company. Show less

**ASOS CMDS Platform**Technical Contributions:* Played a pivotal role in designing and implementing a scalable cloud analytics platform for ASOS's CMDS project, integrating Google Cloud services (Storage Transfer, BigQuery, Cloud Functions, Pub/Sub) for efficient data orchestration.* Established comprehensive SRE practices, including proactive monitoring and alerting, to ensure platform reliability and uptime.* Enhanced security by implementing VPC Service Controls… Show more **ASOS CMDS Platform**Technical Contributions:* Played a pivotal role in designing and implementing a scalable cloud analytics platform for ASOS's CMDS project, integrating Google Cloud services (Storage Transfer, BigQuery, Cloud Functions, Pub/Sub) for efficient data orchestration.* Established comprehensive SRE practices, including proactive monitoring and alerting, to ensure platform reliability and uptime.* Enhanced security by implementing VPC Service Controls, mitigating data exfiltration risk and applying granular access policies.* Automated infrastructure deployments using Terraform and a CI/CD pipeline, streamlining release processes and ensuring version control.Service Level & MSP Contributions:* Championed service reliability: Defined comprehensive Service Level Agreements (SLAs) for Looker availability, query latency, data freshness (Google Ads & Azure), incident response time, and resolution time.* Collaborated with stakeholders to establish data freshness requirements, ensuring timely insights that aligned with ASOS's business needs.* Contributed to incident management: Developed a tiered incident classification system (P1-P4) for the Managed Service Provider environment, enabling rapid response and escalation of critical issues. * Measured service performance against SLAs, driving accountability and continuous improvement of the platform. Show less

Anti-Piracy Data Lake:* Developed fully-fledged, composable, and reusable Terraform modules to streamline the infrastructure of Sky's anti-piracy data lake, promoting maintainability and scalability. * Built robust Concourse CI/CD pipelines to automate the provisioning of multiple GCP environments, enhancing deployment efficiency.* Designed a custom monitoring dashboard for Cloud Composer, providing crucial insights into ETL health and enabling proactive issue resolution.*… Show more Anti-Piracy Data Lake:* Developed fully-fledged, composable, and reusable Terraform modules to streamline the infrastructure of Sky's anti-piracy data lake, promoting maintainability and scalability. * Built robust Concourse CI/CD pipelines to automate the provisioning of multiple GCP environments, enhancing deployment efficiency.* Designed a custom monitoring dashboard for Cloud Composer, providing crucial insights into ETL health and enabling proactive issue resolution.* Empowered Sky's internal team by providing upskilling and training, fostering autonomous solution management. Show less

CloudSQL to BigQuery Streaming Service:* Built a scalable CloudSQL to BigQuery migration solution for MuchBetter. Skillfully utilized and adapted the Google open-source CDC Dataflow template for efficient data synchronization.* Engineered a real-time data capture and streaming system utilizing a Debezium embedded connector in GKE with auto-scaling capabilities, syncing data from CloudSQL to BigQuery.* Enhanced data governance by orchestrating a data catalog to manage table metadata.… Show more CloudSQL to BigQuery Streaming Service:* Built a scalable CloudSQL to BigQuery migration solution for MuchBetter. Skillfully utilized and adapted the Google open-source CDC Dataflow template for efficient data synchronization.* Engineered a real-time data capture and streaming system utilizing a Debezium embedded connector in GKE with auto-scaling capabilities, syncing data from CloudSQL to BigQuery.* Enhanced data governance by orchestrating a data catalog to manage table metadata. * Designed and implemented a robust Pub/Sub-based change capture and buffering system to ensure data integrity.* Developed production-ready Helm charts and adopted Sealed Secrets to bolster Kubernetes deployment security.* Integrated an operator to automate rolling upgrades, minimising downtime during updates. Show less

Neuron Platform:**Core Platform Team*** **Platform Builder (Neuron):** Built and provisioned a GCP big data platform using Terraform for the Neuron project, empowering data engineering and AI/ML initiatives across Vodafone markets.* **Terraform Mastery:** Refactored existing Terraform code for modularity and composability, enabling efficient reuse and customization across Vodafone's global markets. **2. CI/CD Enhancements & ChatOps*** **Jenkins CI/CD:**… Show more Neuron Platform:**Core Platform Team*** **Platform Builder (Neuron):** Built and provisioned a GCP big data platform using Terraform for the Neuron project, empowering data engineering and AI/ML initiatives across Vodafone markets.* **Terraform Mastery:** Refactored existing Terraform code for modularity and composability, enabling efficient reuse and customization across Vodafone's global markets. **2. CI/CD Enhancements & ChatOps*** **Jenkins CI/CD:** Developed Jenkins pipelines implementing Git workflows and container-based CI/CD processes (Docker) for the Neuron platform.* **ChatOps Integration:** Streamlined team communication by building a Slack integration to provide GOCD pipeline notifications. **3. Advanced Automation*** **Cloud Security Automation:** Developed a Python-based templating solution (Jinja) to deploy multiple Cloud Armor policies, enhancing infrastructure security for the Neuron platform.* **Vault Deployment:** Deployed a production-ready Vault Enterprise cluster using custom Kubernetes script and Python templating. Provided robust secrets management with multi-tenancy support for Neuron's global reach.**4. Collaboration & Support*** **Google Partnership:** Collaborated directly with Google engineers to test features and troubleshoot issues, demonstrating strong technical partnerships.* **Global Enablement** As part of the core UK platform team, supported multiple Vodafone markets (Spain, Portugal, Italy, and more.) during the development and deployment of new infrastructure features for the Neuron platform. Show less