Sandhya Shetty Email & Phone Number

• Implemented ADF pipelines for data-driven work flows incloudfororchestratingandautomating data movement and data transformation.• Implemented Eventand Scheduled basis triggers to extract the files from Azure Blob Storage to ADLS Gen2 Storage.• Created Pipelines to extract the data using Copy Data activity and transformed it using Databricks Notebook activity and finally loaded it into SQL table using Copy Data activity.• Implemented pipelines according to business rules by using different ADF activities like IF Condition, For Each, Get MetaData, Set Variable, Filter and Execute Pipeline. Etc• Invoked child Pipelines run from master Pipeline using Execute Pipeline activity by passing master Pipeline parameters.• Used Until and Wait Activities to keep another Pipeline run in queue while current Pipeline run is In Progress.• Created Pipelines to load the data from ADLS Gen2 folders with parquet/delta file formats into SQL database tables.• Extensively used Azure DevOps process to create repositories to save all the codes related to DataBricks, Data Factory, Logic App and SQL tables/views.• Collaborated very well with others take holders like platform,Azure DevOps teams in case of moving code from development to production environments.

• Created Azure Logic App resource to post the request using web activity in ADF to send automated emails to business/project resources to acknowledge Pipeline Success/Failures.• CreatedAzureLogicAppresourceto copytheAttachmentfromthemailsentbythebusiness users. Used For Each, If, HTTP activitiesto copy the attachmentto the staging folder in Azure Blob and automatically triggered ADF pipeline from Logic App to convert the file from unstructured to structured format using DataBricks Notebook.

Bachelor'S Degree, Electronica And Communication Engineering

Orchestreated Devops For 8 Months Using Jenkins As Orchestration Tool For Implementing Ci/Cd Pipelin

Data Engineer