Lead Data Engineer
Current• Optimized and maintained data pipelines across multiple systems (e.g., Snowflake and Teradata), improving data processing efficiency by 40%.• Resolved data discrepancies and irregularities with source data systems, reducing discrepancies to 2%.• Conducted root cause analysis to improve model accuracy and increased revenue by 0.5%• Directed the migration from Talend to Airflow, resulting in a 25% reduction in ETL process times.• Implemented automated change management with GITLAB, reducing code errors and process failures by 30%.• Design strategies and prepare data pipeline for predictive metric modelling and feature engineering• Document developments, processes and bugs under JIRA projects• Skilled in managing resources, including task allocation and mentoring, encouraging team to acquire new skills• Implemented new analysis techniques to enable informed decision-making• Assessed team performance and offered constructive feedback for improvement