Senior Data Engineer
Current1. Led data-related GCP project migration/merge to simplify the overall workflow.2. Main developer for collecting customers' analytical, events, and feedback data.3. Lead developer on ETL pipelines with Talend/SNPGlue to load data from SAP to BigQuery/Snowflake.4. Built other ETL pipelines to load data Using Terraform and AWS lambda.5. Setup data alerting for data pipelines with Cloud Pub/Sub, Cloud functions, and metaplane.6. Worked with teammates to transform legacy data transformation pipelines(GCP scheduled queries) into DBT and set up best practices documentation.7. Implemented fine-grind RBAC through Terraform.8. Maintainance and improvements(including version upgrades) on the existing airflow/composer infrastructure.9. Worked with teammates on GCP to Snowflake migration.