Key responsibilities:• Analyse, design and build Modern data solutions using Azure PaaS services to support visualisation of data. Understand current production state of application and determine the impact of new implementation on existing business processes.• Extract, Transform & Load data from various source systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL, Azure Data Lake Analytics. Data Ingestion to one or more Azure services - Azure DataLake, Azure Storage, Azure SQL, Azure DW, and process the data in Azure Databricks.• Created Pipelines in ADF using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different source like Azure SQL, Blob Storage, Azure SQL Data Warehouse, write-back tool and backwards.• Developed Spark Applications using PySpark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analysing & transforming data to uncover insights into the customer usage patterns.• Responsible for estimating the cluster size, monitoring & troubleshooting of the spark databricks cluster.• Experienced in performance tuning of Spark applications for setting right batch interval time, correct level of parallelism and memory tuning.

Key responsibilities:• Delivered excellence in creating data migration strategy and quality & backup plans, mapping data migration requirements, taking ownership of design, development & testing of all data Extract, Transform & Load (ETL) activities, documenting all ongoing data transformation, de-duplication, extraction & load functions in detailed data lineage models, ensuring high accuracy of all transformed data and mitigating potential risk in migration• Extensive experience in testing, monitoring & validating data integration activity, including data extraction, cleansing, transformation, movement, loading and updating processes• Experienced in coordinating with clients to gather & map business requirements and translate the same into technical specifications & custom solutions• Managed complete ETL/ Data Warehouse Development Lifecycle including Enterprise Architecture, Data Analysis, Database Design, Database Performance Tuning, Data Warehouse Optimisation, and so on• Excellence in complete Software Development Lifecycle including analysis, design, development, testing, implementation & maintenance while assuring timely delivery and completion• Documented HLD & LLD documents with target of achieving minimal re-work as part of feedback• Experienced in leading teams of 5+ members

Trained on SQL, Informatica PowerCentre, Informatica MDM