. Having over all 10 + years of exp with 5 years of experience with Hadoop Ecosystem including Spark, Scala,HDFS, Map Reduce, Hive, Pig, Storm, Kafka, YARN, HBase, Oozie, Zookeeper, Flume,Sqoop, • Assisted in Cluster maintenance, Cluster Monitoring and Troubleshooting, Managing and Reviewing data backups and log files.• Excellent ability to use analytical tools to mine data, Predictive analysis, evaluating the underlying patterns and implement complex algorithms for data analysis.• 1.5 Year Hands On experience on SPARK, Spark Streaming, Spark Mlib, SCALA, • Creating the Data Frames handle in SPARK with Scala• Hands On experience on developing UDF, DATA Frames and SQL Queries in SPARK SQL• Developed PIG Latin scripts and SPARKSQL scripts for handling data formation.• Hands on experience on Real Time data tools like Kafka and Storm.• Developed SQOOP Scripts for importing large dataset from RDBMS to HDFS• Creating the UDF’s in Java and Register them in PIG and HIVE• Good understanding on Spark architecture and its components..• Expertise in working with Hive data warehouse tool-creating tables, data distribution by implementing partitioning and bucketing, writing and optimizing the HiveQL queries.• Experience in using Apache Sqoop to import and export data to and from HDFS and Hive.• Hands on experience in setting up workflow using Apache Oozie workflow engine for managing and scheduling Hadoop job• Experience in scheduling the jobs using Oozie Coordinator, Bundler and Crontab. Cloud Infrastructure: • Experienced in working with different file formats - Avro, Parquet, RC and ORC.• Hands on experience in configuring and working with Flume to load the data from multiple sources directly into HDFS.• Experienced and skilled Agile Developer with a strong record of excellent teamwork and Successful coding