• Overall 11 years of experience in Enterprise Application and product development. • Experience in developing and deploying enterprise based applications using major components in Hadoop ecosystem like HDFS, MapReduce, YARN, Hive, Pig, HBase, Flume, Sqoop Spark, Storm, Scala, Kafka, Oozie, Zookeeper,.• Experience in Hadoop administration activities such as installation, configuration of clusters using Cloudera Manager, Apache Ambari, and troubleshooting using Hadoop ecosystem components in HDP.• Expertise in Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, MRv1 and MRv2. • Extensive experience in writing MapReduce programs in Java and scala for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats. • Experienced in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and vice-versa.• Extensive experience in designing online analytical processing-OLAP and online transaction processing- OLTP databases.• Experienced working with Hortonworks Distribution and Cloudera Distribution. • Expert knowledge in creating Agile Test Strategy, Test Cases, Test Scenarios by reviewing business, functional, and non - functional requirements. • Proficient in developing data transformation and other analytical applications in Spark, Spark-SQL using Scala programming language.• Profound experience in creating real time data streaming solutions using Apache Spark Streaming, Kafka, Strom, Nifi, AKKA and RabbitMQ. • Experience in developing and designing POCs deployed on the Yarn cluster, compared the performance of Spark, with Hive.• Very good experience in complete project life cycle (design, development, testing and implementation) of Client Server and Web applications.
Listed skills include Core Java, Amazon Web Services, Test Automation, Linux, and 17 others.
