Experience data engineer with over 4 years of expertise in building and optimizing high throughput ETL pipelines and high-performance data lakes. Proficient in using advanced big data technologies, including map reduce, Hive, YARN, Spark, Spark SQL, and Dynamo DB. Skilled in working with popular Hadoop distribution platforms like Cloudera, and experienced in writing UDFs in JAVA and SCALA for HIVE QL and SPARK. Adept at optimizing Hive and Impala queries for better performance and troubleshooting complex issues within the Hadoop ecosystem. • Strong background in Python object-oriented programming (OOP) and comprehensive experience across all stages of the Software Development Life Cycle (SDLC). Proficient in writing subqueries, stored procedures, triggers, cursors, and functions in MySQL and PostgreSQL databases.• Proven ability in deploying clusters on EMR, managing data storage in S3, and constructing data pipelines using AWS services such as S3, EC2, EMR, IAM, and CloudWatch. Familiar with development tools like Bugzilla and Jira, and experienced with databases including MySQL, Oracle, SQL Server, NoSQL, and PostgreSQL.• Proficient in version control using SVN and GIT, with strong knowledge in agile and waterfall methodologies, unit testing, and Test-Driven Development (TDD).• Highly skilled in AWS services for deployment, data security, troubleshooting, and scripting in Shell, Bash, and various operating systems including Linux, and Windows.• Excellent communication, interpersonal, and analytical skills, with a strong ability to understand complex systems, provide solutions, maintain detailed documentation, and work both independently and as a motivated team player.