• Motivated Data Engineer having 8+ years of professional experience in Data Engineering, Analytics, Data Modeling, Data Science, Data Architecture, Programming Analysis and Database Design of OLTP and OLAP systems with sound knowledge in Cloud Technologies (AWS, Azure).• Domain expertise in E-commerce, Healthcare, Enterprise Systems, Financial Sector. Skilled in working with cross-functional teams to design, develop and implement data-driven solutions with large data sets to solve complex business problems.• Performed data engineering functions: data extraction, transformation, loading, and integration to support enterprise data infrastructures - data warehouse, operational data stores, and master data management.• Good experience in creating and designing data ingest pipelines using technologies such as Apache Storm- Kafka and Experienced in writing live Real-time Processing using Spark Streaming with Kafka as a data pipeline system.• Strong programming capability using Python and Hadoop framework utilizing Cloudera Hadoop Ecosystem projects (HDFS, Hadoop, Sqoop, Hive, HBase, Oozie, Impala, Zookeeper, etc.)• Experience in designing a Terraform and deploying it in cloud deployment manager to spin up resources like cloud virtual networks.• Highly Skilled at Python coding using SQL, NumPy, Pandas, and Spark/Pyspark for Data Analysis and Model building, deploying, and operating highly available, scalable, and fault-tolerant systems using Amazon Web Services (AWS).• Proficient in Hive Query language and experienced in Hive performance optimization using Static- Partitioning, Dynamic-Partitioning, and Bucketing and Parallel Execution concepts.• Designed and engineered on-premises to off-premises CI/CD Docker pipelines (integration and deployment) with ECS, Glue, Lambda, ELK, Redshift spectrum Kinesis Firehose, and Kinesis stream.• Developed Real-Time data feeds and microservices leveraging AWS Kinesis, Lambda, Spark Streaming etc., to enhance good analytical opportunities and influence customer content and experiences.• Experience working on version control systems like GIT and used Source code management client tools like Git Bash Scripting, GitHub, Git GUI, and other command-line applications.• Excellent understanding and working experience of industry-standard methodologies like System Development Life Cycle (SDLC), as per Rational Unified Process (RUP), AGILE, and Waterfall Methodologies.• Excellent communication, interpersonal, analytical skills, and strong ability to perform in a team and as an individual team member.