Lead Data Engineer
CurrentCurrently in an Agile Tribe set-up focused on delivering the business needs of different Tribes related to data ingestions to data warehouse platform. My current responsibilities as a DE in GCash are:· Develop data pipelines with Alibaba DataWorks utilizing MaxCompute for managing large-scale data processing and transformation workflows.· Ensures adherence to data engineering best practices, including code version control, ensuring readability, functionality, scalability, performing test runs, managing deployments, and providing post-deployment support.· Performing Data Quality Checking (DQC & Unit Test)Tech Stack: SQL (ODPS SQL), Python 3 (PyODPS), ETL (DataWorks)