• 6+ years of professional experience in IT, including Big Data, Hadoop. Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.• 4+ years of work experience in ingestion, storage, querying, processing, and analysis of Bigdata with hands on experience in Big data Eco- system related technologies like Map Reduce, Hive, Spark, Cloudera, Hortonworks, Navigator, Mahout, HBase, Pig, Zookeeper, Scoop, Flume, Oozie and HDFS.• Good experience in writing Map Reduce jobs using Java native code, Pig, Hive for various business use cases.• Extensive knowledge in writing spark scripts in python and Scala.• Strong knowledge in the development of Data Pipeline based on the Business requirements.• Worked with Amazon Web Services (AWS), Amazon S3 to download ad-hoc feed data• Experience in developing scalable solutions using NoSQL databases including HBASE, CASSANDRA, MongoDB and Couch DB.• Responsible for performing reads and writes in Cassandra and web application by using java JDBC connectivity.• Experience in setting up the Kerberos in production for security enhancement.• Extensively used Java and J2EE technologies like Core Java, Java Beans, Servlet, JSP, spring, Hibernate, JDBC, JSON Object, and Design Patterns.• Good experience working on Tableau & Spotfire & enabled the JDBC/ODBC data connectivity from those to Hive tables.• Deep understanding of Tableau features such as site and server administration, Calculated fields, Table calculations, Parameters, Filter's (Normal and quick), highlighting, Level of detail, Granularity, Aggregation, Reference line and many more.• Working knowledge of Scrum, Agile and Waterfall methodologies.• Extensively experience in working on IDEs like Eclipse, Net Beans, PyCharm and Edit Plus.• Good working experience in designing Oozie workflows for cleaning data and storing into Hive tables for quick analysis.• Integrated Oozie with Hue and scheduled workflows for multiple Hive, Pig and Spark Jobs.• In-Depth knowledge of Scala and Experience building Spark applications using Scala.• Import the data from different sources like HDFS/HBase into Spark RDD.• Knowledge of processing and analysing real-time data streams/flows using Kafka and HBase.• Experience in working with Apache Sqoop to import and export data to and from HDFS and Hive.• Responsible for performing extensive data validation using HIVE Dynamic Partitioning and Bucketing.• Experience in using Apache Sqoop to import and export data to and from (different sources) HDFS and Hive.