Etl Developer
CurrentImplemented the next phase of the Program Data Repository system by developing robust ETL pipelines for ingesting operational data from the Raw Data Repository. Collaborated with trusted partners to ensure data availability in our data warehouses for users of the Self-Service Analytics Dashboard (SSAD) in Tableau.• Designed, developed, tested, and maintained multiple Apache NiFi and Google App Engine Python pipelines to extract data from Google BigQuery, MySQL, REST APIs, JSON files, and Google Cloud Storage, inserting data into PostgreSQL databases. • Conducted Python code reviews.• Developed 13 Google App Engine scheduled jobs in Python to call third-party APIs for ingesting and transforming medical data.• Worked with Jupyter notebooks to visualize data quality reports.• Utilized explain plans in PostgreSQL for high-performance updates, selects, and inserts.• Queried object metadata to assist in building data dictionaries.• Performed Linux administration and created shell scripts for use in Google Cloud Virtual Machines• Demonstrated a strong understanding of Agile methodologies by using Jira to estimate and track work progress in 2-week sprints