• 3 years of professional experience in data analysis with strong communication and leadership skills.• Worked on reviewing business requirements and developed Big Data solutions focused on pattern matching and predictive modeling.• Handled data ingestion from various external data sources and performed transformations using spark.• Implemented ETL Pipelines and Data Lake solution using Azure Data Engineering technologies such as Azure Data Factory (ADF), Azure Data Lake Gen2, Azure Blob Storage, Azure SQL Database, Azure Databricks, Azure HDInsight, and Microsoft PowerBI.• Expertise in building end to end Data processing Jobs to analyze data using MapReduce, Spark, and Hive.• Integrated data from HTTP clients, Azure Blob Storage and Azure Data Lake Gen2 using Azure Data Factory.• Skilled in performing data parsing, data ingestion, data manipulation, data architecture, data modelling and data preparation with methods including describe data contents, compute descriptive statistics of data, regex, split and combine, Remap, merge, subset, reindex, melt and reshape.• Experience in Microsoft Azure/Cloud Services like SQL Data Warehouse, Azure SQL Server, Azure Databricks, Azure Data Lake, Azure Blob Storage, Azure Data Factory, Cosmos DB,• Experience working on Azure Services like Data Lake, azure synapse analytics, SQL Database, Synapse, Data Bricks, Data factory and SQL Data warehouse.• Experience in extracting data from Production databases through Sqoop, performed in data validations, managed the jobs in Prod environment.• Worked with NoSQL databases like HBase and performed CRUD operations, ingested large data sets of semi-structured data coming from various sources. • Performed data preprocessing and feature engineering for further predictive analytics using Python Pandas.• Worked on extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics.• Ability to create scripts using Azure Shell for automation and build process.• Created dashboards in PowerBI designing with large data volumes from data source SQL server.