• Extensively used ETL methodology for developing Data Extraction, Transformation, and processing of data from Sources like API’s, Oracle, SQL Server, SharePoint, SFTP, Files using Azure Data Factory into Azure Data Lake Storage, Blob storage and SQL DW• Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL• Created ETL pipelines for Batch and near real time data using ADF, logic apps, data flows.• Developed Dynamic, optimized, and incremental ETL pipelines to load data from various sources using ADF and Databricks and deploying ADF CI/CD changes with Azure DevOps.• Developing, maintaining, and managing reporting, analytics, dashboards with AAS and Power BI.

• Managed 5 TB data warehouse for the Retail department which included Sales transactions, financial data. • Designed and implemented data pipelines on azure using various resources like ADF, ADLS, SQL DB, SQL DW. • Consumed raw/unstructured data from source system and wrote stored procedures using T-SQL to extract and transform the data to user/client specific form and then exported to different peer system.• Fixing defects raised during System testing, System Integration testing, User acceptance testing• Worked in the agile methodology. • Onsite experience on implementation project for retail customer (Cape Town).