Worked on developing and enhancing the ingestion framework used for ingesting thedata from dynamic sources to Synapse Dedicated SQL pool.ADF, Databricks, Pyspark, SQL, Synapse etc are the skills used for developing theabove frameworkDeveloped multiple ADF pipelines to ingest data from external sources into ADLS & blobstorage accounts.Data from the above containers is processed through Landing, Loading, History, Certifiedand Reporting zones.Data Validation is implemented while data is moved from Landing to Loading zone.From Loading zone data is stored in the form on delta and is processed across differentlayers as per the business use cases.Implemented various features such as archival, data rehydration, change data capture,creating dynamic views using metadata etc.Worked on creating the RDDs, DFs for the required input data and performed the datatransformations usingꢀ Pyspark and Spark-SQL.Developed multiple stored procedures and functions for inserting and updating data totables.Created multiple tables based on the entity-relationship diagrams of the table columns.Performed Testing the framework through a wheel file version by adding to data brickscluster.Document all the developed stored procedures, adf pipelines along with test values toSend communication to all the customers.Contributes towards Analysis, Design, Development, Production, and implementation ofETL projects in Azure.

Major ETL/ELT(Transformations) are done through ADF and invoked by Using ScheduleTriggers.Designed and developed data ingestion pipelines from on-premises to different layersinto the ADLS using Azure Data Factory.Developed Azure Data Factory Objects - ADF pipeline, configuration, parameters,variables, Integration services runtime.Done necessary transformations on Unstructured data through ADF Transform.Experience with integration of data from multiple data sources.Implementing slowly changing dimensions, Incremental Loading and sending failmessages through azure logic apps.

Involved in weekly client meetings, preparing weekly reports, and presenting to Clients.Scheduling the Webex calls across the global customers and sharing the knowledge ofthe latest applications to all the customers.Worked on installation of standalone applications on customers on-premises virtual.machines and supported in analyzing the Kibana and log4j logs of the applications.Reproduced customer issues by installing the packages in my on-premises environment tounderstand the problem area and provide accurate resolution in the SLA Time.