Senior Hadoop Developer
Current• Worked on the RDBMS system using PL/SQL to create packages, procedures, functions and triggers as per the business requirements.• Involved in ETL, Data Integration and Migration.• Ran ETL jobs on the data in HDFS.• Imported data using Sqoop to load data from HBase to HDFS on a regular basis.• Developing scripts and batch jobs to schedule various Hadoop Programs.• Developed Pig Scripts, Pig UDFs and Hive Scripts, Hive UDFs to load data files into Hadoop• Have written… Show more • Worked on the RDBMS system using PL/SQL to create packages, procedures, functions and triggers as per the business requirements.• Involved in ETL, Data Integration and Migration.• Ran ETL jobs on the data in HDFS.• Imported data using Sqoop to load data from HBase to HDFS on a regular basis.• Developing scripts and batch jobs to schedule various Hadoop Programs.• Developed Pig Scripts, Pig UDFs and Hive Scripts, Hive UDFs to load data files into Hadoop• Have written Hive Queries for data analysis to meet the business requirements.• Creating Hive Tables and working on them using Hive QL.• Importing and exporting data into HDFS from HBase, and vice versa using Sqoop.• Experienced in defining job flows.• Experience with NoSQL database HBase. • Wrote and modified stored procedures to load and modifying of data according to business rule changes.• Involved in creating Hive Tables, loading the data and writing Hive Queries that will run internally in a map reduce way.• Developed a custom file system plugin for Hadoop to access files on data platform. • The custom file system plugin allows Hadoop Map Reduce programs, HBase, Pig, and Hive to access files directly.• Extracted feeds from social media using Python scripts.• Organized and benchmarked Hadoop/HBase Clusters for internal use. Show less