• Worked on creating different data pipeline using hive, oozie and shell scripting. • Worked on designing and developing a complex project to do risk rating for the customer. • Worked on extracting the data and putting them in same format to hbase using bulk loading and applied ETL transformation using hive queries, drools, java etc.• Implemented various Hbase functionality using mapreduce as well. • Creating Change Request for deploying the developed applications into… Show more • Worked on creating different data pipeline using hive, oozie and shell scripting. • Worked on designing and developing a complex project to do risk rating for the customer. • Worked on extracting the data and putting them in same format to hbase using bulk loading and applied ETL transformation using hive queries, drools, java etc.• Implemented various Hbase functionality using mapreduce as well. • Creating Change Request for deploying the developed applications into production using Jenkins, maven, Git.• Work closely with client to do the system and architectural design of a new data source.• Work on the row key design for data coming from new source while taking care of hot spottin Show less

•Currently working on Migrating Hive queries to spark platform using sparksql and for performance optimizations•Performed technical analysis of existing legacy application and participated in design solutions for migrating the same to Hadoop distributed platform.• Extensive experience in Big Data ecosystem and its various components like Hadoop-MapReduce, Pig, Hive, Hbase, Sqoop & Flume, Hadoop-Yarn, Basic knowledge of Spark, java API to work on it. •Implemented… Show more •Currently working on Migrating Hive queries to spark platform using sparksql and for performance optimizations•Performed technical analysis of existing legacy application and participated in design solutions for migrating the same to Hadoop distributed platform.• Extensive experience in Big Data ecosystem and its various components like Hadoop-MapReduce, Pig, Hive, Hbase, Sqoop & Flume, Hadoop-Yarn, Basic knowledge of Spark, java API to work on it. •Implemented Hadoop/Map-Reduce ETL jobs for Retail data Processing and Reporting.•Query Optimization / Query Performance Tuning For Large Database using Hints, explain plan• Source data in HDFS from Linux. Process and format data in appropriate format. Involved in the continuous enhancements and fixing of production problems involving HIVE & PIG.• Worked on Importing and exporting data from different databases like Oracle, Teradata into HDFS and Hive using Sqoop. • Experienced in performing analytics on structured and unstructured data using Hive queries.• Involved in developing the Hive Reports, Partitions of Hive tables• Experience in high-end programming using PL/SQL,SQL*Plus, SQL*Loader, Unix Shell Programming/Scripting and writing triggers, stored procedures and functions at backend•Developed cost effective Utilities using UNIX & Oracle to automate manual tasks Show less