Data Engineer
Current- Designed and implemented scalable data pipelines for 9 key markets in Southeast Asia, enabling efficient data flow for lead generation projects, responsible for leads data transfer.- Automated lead generation processes to improve efficiency and reduce manual effort, reduced the duplication rate by 30%, clients upsell by month.- Deployed and optimized an Apache Airflow 2.0 data orchestration platform, significantly improving data pipeline efficiency and reliability, better utilized the resources (worker nodes autoscaling, significantly reduced about 60% the cost for Airflow by using preemtible pool on k8s, the execution time decreased rapidly after DAGs modification, …).- Designed and deployed an auto-backfilling system for HHG data warehouse to prevent data from discontinous, inconsistent data, ensure the data quality.- Developed custom Google Apps Script solutions to streamline contract management, client delivery, and performance tracking processes for cross-functional teams.- Engineered a robust and comprehensive data analytics solution integrating multiple data sources (Meta API, Google Analytics, Google Ads Manager, YouTube API, TikTok API) to provide actionable insights into marketing performance.- Contributed to the development of SIDIS, an all-in-one data integration system, empowering the Marketing team to independently create targeted audience segments.- Participated in the data architecture designing and implementation of data pipelines for critical data products, including Doctor KOL, MSD Readiness, …- Developed and deployed RESTful APIs to integrate with Hello Health Group's community database and implemented webhooks to capture events from Meta, Line, etc, enabling seamless data flow.- Designed and implemented a scalable phone verification solution using iMedia (for Vietnam market) and Twilio (for other markets) to enhance user authentication and enrich data quality.
