Harendra V Email & Phone Number

United States

• Involved in Analyzing data from different sources like Oracle, MySQL and Sqooping data into Hive using Sqoop.
• Involved in identifying customers using unstructured data with Pyspark.
• Written Shell scripts to initiate jobs with required features and environment.
• Involved in moving huge data between servers in Hadoop by using compression techniques.
• Created a Realtime data pipelines and frameworks with Kafka, Spark streaming and loading data to Hbase also feeding APIs.
• Developed ETL jobs to automating the several student’s data from enrollment step to graduation process and service fee calculation for weekly finance payment to Confidential.

• Optimized existing Hive scripts using many hive optimization techniques.
• Built reusable Hive UDF libraries for business which enables users to reuse.
• Involved in creating Hive tables, loading and analyzing data using hive queries.
• Worked on implementing Flume to import streaming data logs and aggregating the data to HDFS through Flume.
• Imported data from various data sources performed transformations using spark and loaded data into hive.
• Worked with spark core, Spark Streaming and spark SQL modules of Spark.

United States

• Created Data Lake by extracting customer’s data from various data sources in HDFS. This includes data from Teradata, Mainframes, RDBMS, CSV and Excel.
• Involved in design and development of Data transformation framework components, which gets the single complete Actionable View of customer.
• Used Apache Hive to run map reduce jobs on top of HDFS data.
• Build distributed in-memory applications using Spark and Spark SQL to do analytics efficiently on huge data sets.
• Involved in performance optimization of spark jobs and designed efficient queries to query data and Hbase.
• Implemented Composite server for the data virtualization needs and created multiples views for restricted data access using a REST API.

United States

• Develop Pig Latin scripts to extract data from the output files to load into HDFS.
• Developed workflow in Oozie workflow scheduler to automate and schedule the tasks of loading the data into HDFS and pre-processing with Pig.
• Developed data pipeline using Flume, Sqoop, Pig and Java MapReduce to ingest customer behavioral data andfinancial histories into HDFS for analysis.
• Developed complex Talend jobs mappings to load the data from various sources using different components.
• Used Zeppelin Notebook to execute SQL queries on SQL databases.
• Involved in installing AWS EMR framework.

India

• Involved in deployment of full Software Development Life Cycle (SDLC) of the tracking system like Requirement gathering, Conceptual Design, Analysis, Detail design, Development, System Testing and User Acceptance
• Worked in Agile Scrum methodology
• Involved in writing exception and validation classes using core java
• Designed and implemented the user interface using JSP, XSL, DHTML, Servlets, JavaScript, HTML, CSS and AJAX
• Developed framework using Java, MySQL and web server technologies
• Validated the XML documents with XSD validation and transformed to XHTML using XSLT

Master'S Degree, Computer Science

Bachelor'S Degree, Computer Science