Data Eng, Mgmt & Governance Analyst
Current• Developed and implemented comprehensive data pipelines for end-to-end ETL processes on Google Cloud Platform (GCP).• Successfully migrated on-premise ETLs to GCP, utilizing native tools such as BigQuery, Google Cloud Storage, and Composer.• Enhanced and troubleshooted existing data flow jobs to address data issues, ensuring data integrity and accuracy.• Created sophisticated Type1 and Type2 Change Data Capture (CDC) workflows for both batch and historical data loads.• Constructed ETL pipelines in Airflow/Composer on GCP, employing various Airflow operators for diverse data processing tasks.• Led efforts in data extraction, migration, validation, encryption, and replication from on-premises systems to GCP.• Technology Stack: GCP Composer, BigQuery, Cloud SQL, Cloud Functions, Cloud Dataflow.