Data Engineer
Current• Reduced the time of ingestion work by more than 50% by creating an automation framework forgenerating metadata and conducting unit testing to verify counts and duplicates.• Improved the Tableau report SQL query performance by more than 90% by implementing temporary tables, common table expressions (CTE), and splitting long-running queries into smallerones.• Reduced batch processing delay from 40 minutes to less than 10 minutes by running high volumejobs in parallel in Control-M and creating a new table that extracts columns relevant to businessneeds.• Reduced data validation time for batch cycles by more than 90% by creating audit jobs for allindividual sources.• Worked on both full and incremental load tables.• Conducted numerous migrations using Python code from on-premises SQL Server and mounteddrives to Snowflake.
