- Led the migration from Oracle Data Integrator (ODI) to Apache Airflow

- Development and maintaining streaming / batch processing pipelines;- Utilising an event sourcing architecture to handle real-time data streams;- Query optimisation and reducing response time for data retrieval on the Production Env;- Monitoring data processing tasks and ensuring smooth data flow;

- Prepared detailed validation reports, documenting findings, recommendations, conclusion, and presented them to senior management;- Stayed up-to-date with industry trends, regulatory guidelines, and emerging best practices in risk modeling and validation, proactively suggesting improvements and enhancements to existing processes;

- Integrated new data sources by connecting to APIs from governmental services;- Implemented preprocessing and filtering for text reviews to enhance data quality;