Senior Data Engineer/ Data Modeler
- Created a process for loading the data from different sources to target tables in the concept of one readand one write for loading it into multiple layers. This reduced the efficiency of the data loading andprevented.
- Worked on Data Quality validations (QA) using the unified approach for delivering accurate results.
- Created Shell scripts for bringing the on-premises data to Azure and implemented the error handlingtechniques.
- Implemented scripts for a unified batch handler process that loads data into silver, refined, and refresheddata in Snowflake.
- Experience in ADF, ADB, Storage accounts, CI/CD best practices, unity catalog, and wrote scripts forreusable & efficient data loading.