A highly skilled Data Engineer with over 9 years of experience in building and deploying data pipelines using open-source Hadoop-based technologies like Apache Spark, Hive, and Hadoop, along with Python and PySpark. Possesses around 3 years of expertise in Datacenter Migration and Azure Data Factory (ADF) V2, managing various Azure Data Platform services. Experienced in designing and implementing ETL and data movement solutions using Azure Data Factory and SSIS. Proficient in GCP suite including Big Query, Data Flow, DataProc, Google Cloud Storage, Composer, and Looker. Successfully designed data flow for merging multiple legacy data warehouses into an AWS Data Lake and has hands-on experience developing Spark applications using PySpark. Skilled in using GCP Cloud Storage, DataProc, Data Flow, Big Query, and Cloud Composer, as well as replicating data in real-time with PUB/SUB. Adept at Azure SQL database creation, monitoring, and migration, with extensive experience in database design and development, Business Intelligence, and working with both structured and semi-structured data formats. Knowledgeable in AWS services like Redshift, S3, Glue, Athena, Lambda, and CloudWatch.