Project Associate
CurrentUsed Sqoop to efficiently transfer data between databases and HDFS. Involved in creating Hive tables, loading and analysing data using hive queries. Created partitions, buckets in Hive to handle structured data. Involved in importing and exporting data(Oracle, XML, text file) from external file system and RDBMS to HDFS using sqoop. Implemented spark using Scala and Spark SQL for faster testing and processing of data. Involved in converting Hive/SQL queries into spark transformations using Spark RDD???s and Scala. Used Spark for interactive queries, processing of streaming data . Used Spark to load data and create schema RDD and loaded data into hive tables. Good knowledge on Mongo DB data modelling and querying data.