Senior Data Engineer
Current• Migrates and maintains data pipelines to ingest and transform data from various sources.• Coaches a small team of data engineers in the design, development, and maintenance of ETL pipelines,resulting in lower counts of data related incidents in production.• Collaborates with data analysts and stakeholders to make sure that the transition from on-prem processes to Cloud is smooth.• Conducts bi-weekly end-to-end reviews off all code changes before the deployment in production.• Implements data quality checks to make sure that all data migrated to the new cloud platform are correct.• Works on workflow orchestration and making sure that all on-prem jobs that were already migrated are decommissioned properly with less impact to production.• Fixes high priority issues and data errors, resulting in shorter downtime and less escalations. • Troubleshoots AWS services such as (S3, EC2, Redshift, Lambda)• Taking a part on maintenance, outage, and upgrade planning.