Azure Data Engineer
Current• Using Azure ADF, Databricks, Pyspark for batch loads and preparing real time reports for business using delta tables, SQL-server tables feature.• Implementing Azure-Key Vault to ensure proper security; interacting with multiple downstream partners on daily basis Customer service, Data Science, Analytics, Reporting Team to solve data related issues.• Development of ETL/ELT Pipelines through DataBricks and ADF and populating Data in Ingest, Conform and Analytics layers.• Development of ADF Triggers like Eventbased, scheduled Triggers.• Development of Orchestration Framework through which system will identify and trigger the dependent pipelines.