Bigdata Hadoop Developer
Current Moved all crawl data flat files generated from various retailers to HDFS for further processing. Written the Apache PIG scripts to process the HDFS data. Created Hive tables to store the processed results in a tabular format. Developed the sqoop scripts inorder to make the interaction between Pig and MySql Database. For the development of Dashboard solution, developed the Controller, Service and Dao layers of Spring Framework. Involved in resolving the JIRAs based on Hadoop. Developed the Unix shell scripts for creating the reports from Hive data. Completely involved in the requirement analysis phase.