Senior Data Engineer
Current• Lead a team of engineers to build a common framework to migrate legacy pieces into GCP• Identify the key stakeholders, bring everyone on same platform and Project Kick-off.• Responsible for working with 11 Fleet external Vendors on project alignment & key exchanges for GECHub mailbox setup for file transfer to GCS Buckets• Setting up of GCP Infrastructure which includes GCP Project, Service account & Buckets creation• Setting up of Astronomer, Tekton pipeline and integration of astronomer with GCP infrastructure • Establish Agile principles for design and development of Fleet file processing in GCP and load to PostGre• Establish WebFocus/QlickSense connectivity with PostgreSQL and compare dashboard performance • Responsible for fetching large volume (~25TB) of Teradata tables into GCS Buckets• Ingest Data from Hadoop to Big Query & establish connectivity with WebFocus • Responsible for running Proof of Concepts and spikes identified in the product