•Experience in design and development of Big Data Analytics using Hadoop Ecosystem Tools Pig, Hive, Map Reduce, Spark, Kafka and flume.•Hands on experience in developing and deploying enterprise based applications using major components in Hadoop ecosystem like Hadoop 2.x, YARN, Hive, Pig, Map Reduce, H Base, Flume, Sqoop, Spark, Storm, Kafka, Oozie and Zookeeper. •Expertise in data migration, import & export data from Tera data &MySQL into HDFS and Hive using Sqoop. •Experience in Data Analytics by writing real-time processing data using Spark Streaming with Kafka, Spark SQL and Flume written in Scala and Python. •Excellent understanding of NoSQL databases like HBase, Cassandra and MongoDB. •Experience in writing custom User Defined Functions in java for Hive and Pig.•Experience in UNIX shell scripting and has good understanding of OOPS and Data Structures Comprehensive knowledge and experience in process improvement, normalization/de-normalization, data extraction, data cleansing, data manipulation on HIVE. •Experience in analyzing data using HIVE, PIG Latin and custom Map Reduce programs. •Experience in managing and reviewing Hadoop log files. •Developed Map Reduce programs to perform analysis.•Developed Hive scripts for end user / analyst requirements to perform ad hoc analysis. •Good understanding of partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive.•Extracted data from log files and push into HDFS using Flume. •Scheduled workflow using Oozie workflow Engine.•Worked on performance tuning of existing stored procedures and ETLs.•Hands on experience working on Tableau. •Highly motivated, adaptive and good debugging and communication skills, team player, goal oriented and ability to quickly learn new technologies as required.•Worked as an engineer in the scrum team and participated in the agile ceremonies like sprint planning, user story rooming etc.