Manoj V Email and Phone Number

As an AWS Data Engineer at Fifth Third Bank, I have implemented cloud and big data solutions to enhance customer support and streamline data processing. I collaborate with business process managers and utilize technologies such as Hive, Spark, NIFI, Python, and Apache Airflow for job scheduling in AWS cloud environments. I have experience developing ETL processes in AWS Glue, designing Spark applications using Scala, creating Elasticsearch data models, and writing Snow SQL scripts in Snowflake.I have worked with Kafka, Presto, Hive, and BigQuery for data streaming and analytics. In addition, I have developed optimized Spark applications for data processing tasks and built data pipelines using Spark, Hive, Sqoop, and custom input adapters. My expertise extends to working with DevOps engineers on code deployment and debugging, as well as using HiveQL to develop scripts for data aggregation.Environment: AWS EMR, S3, Spark, PySpark, PL/SQL, Scala, Hive, Sqoop, ETL, Snowflake, Java, Athena, Glue, Maven, GitHub

As an AWS Data Engineer at Ascena Retail Group, I built data ingestion pipelines, transformed and analyzed data using PySpark and Hive, and migrated Teradata data warehouses to AWS S3-based data lakes. I developed Spark applications with Scala for various data processing tasks and utilized GCP Compute Engine and BigQuery services. I worked extensively with AWS cloud services like S3, EMR, Redshift, Athena, and Glue Metastore, and participated in continuous integration using Jenkins in an Agile environment.Environment: AWS EMR, PL/SQL, PySpark, Spark, Hive, HDFS, Sqoop, Kafka, Oozie, HBase, Scala, MapReduce

As an Azure Data Engineer, I developed data pipelines using Spark, Hive, and Sqoop for ingesting, transforming, and analyzing operational data. I leveraged Scala for Spark applications, focusing on data cleansing, validation, transformation, and summarization tasks. I provided IaaS support to clients using Microsoft Azure and Google Cloud Platform services. Additionally, I worked with various database objects, created using T-SQL, and collaborated with cross-functional consulting teams to develop data-driven solutions. I operated in an Agile environment, utilizing Jira, GitHub, and TeamCity for continuous builds.

As a Big Data Developer, I ingested data from various sources, performed data transformations using Hive and MapReduce, and loaded data into HDFS. I developed custom Hive UDFs in Java and created partitioned Hive tables for performance tuning. I scheduled data ingestion and transformation processes using Oozie and Maestro schedulers. I also implemented a streaming data ingestion framework with Kafka and developed Spark applications using Scala and Python. Furthermore, I utilized NoSQL databases such as HBase and optimized performance through various techniques, including distributed cache, partitioning, bucketing, and map-side joins.

Worked with Hadoop architecture components, developed Spark applications, and optimized Hive performance. Configured real-time data processing using Spark Streaming and Kafka, and designed applications for high availability using AWS stack. Gained experience in implementing CI/CD pipelines on GCP, developing advanced SQL queries, and tuning SQL query performance. Worked with databases such as Oracle 10g, SQL Server 2016, and MySQL.