• Senior Azure Data Engineer with expertise in Microsoft Azure, ADF, ADLS, Azure Blob, Azure Synapse Analytics, SQLPool, CosmosDB, Function APP, Data Lake, KeyVault, Azure Subscription, Azure Resource , Databricks, Delta tables, and EventHubs.• Proficient in building pipelines using Azure Data Factory and migrating data into Azure Data Lake Store as a Senior Azure Data Engineer.• Senior AWS Data Engineer with expertise in AWS Glue, AWS S3, Amazon RedShift, Amazon Direct Connect, Amazon EMR, AWS IAM, Amazon RDS, Amazon EC2, AWS Lambda.• Proficient in building pipelines using AWS Glue and migrating data into AWS S3 as a Senior AWS Data Engineer.• Skilled in ETL development using Apache Spark, Pyspark, Kafka Streaming, Hadoop MapReduce, HDFS, Hive, Pig, HBase, Sqoop as a Senior ETL Developer.• Experienced in processing raw data daily through Spark streaming, consuming data from Kafka, and performing real-time processing in Spark and HBase for auditing purposes as a Big Data Developer.• Created Python based Spark applications for data aggregation in enterprise environments as a Senior Big Data Engineer.• REST API Development using Azure Cosmos DB.• In-depth understanding of Classic Hadoop and Yarn architecture, including Hadoop demons like Job Tracker, Task Tracker, Name Node, Data Node, Secondary Name Node, Resource Manager, Node Manager, Application Master, and Containers.• Proficient in Python Developer, and Shell scripting.• Implemented Python scripts to fetch data from AWS S3 Data Extraction, audit its status in HBase, and load it into Hive.• Skilled in using Power BI Visualization for data visualization and analysis in Business Intelligence.• Implemented Software Development Optimization to optimize data processing, storage, and retrieval, ensuring efficient data management and seamless data integration with various systems and Database Management.• Demonstrated leadership skills by effectively leading cross-functional teams, fostering cross-functional collaboration, troubleshooting, problem-solving, and driving data-driven decision-making processes within the organization.