Data Engineering Manager
CurrentLead or worked on : - Migration of data services to EKS (AWS-managed Kubernetes)- Implementation of batch job processing with Airflow and evangelization on good data processing practices- Technical support for the implementation of gRPC and HTTP endpoints related to data (infrastructure, databases, packaging...)- Design of the automation of earnings calculation and invoicing pipeline- Migration to event based system for real-time data processing (SNS + SQS)- Foundations and continuous improvement for data governance (feature, unit and data quality tests, compliance pipelines...)- Infrastructure as code (IaC) for data applications with Terrafom- Those data migrations that one can never escape- CI/CD with Github ActionsSupervised : - Components for model serving and monitoring for production-level ML projects (Seldon, MLFlow)- Data systems Monitoring and alerting (NewRelic, Cloudwatch)Management:- Worked on elaboration of company's engineering pillars- Mentoring junior and confirmed engineersFocus:- Understanding core business needs- Delivering actual value for product and business teams- Develop autonomy for data analysts and scientists- Provide a global data vision that can sustain scale and future challenges/projects- Understand and circumvent bottlenecks related to data.- Aligning teams and people with common objectives/vision.
