Kaushik Kumar Email & Phone Number

Cincinnati, Oh, Us

• Analyzed large data sets by running Hive queries and Pig scripts.• Worked extensively with Sqoop for importing and exporting the data from HDFS to Relational Database system Oracle and vice-versa.• Involved in creating Hive tables, and loading and analyzing data using hive queries.• Developed Simple to complex MapReduce Jobs using Hive and Pig.• Involved in running Hadoop jobs for processing millions of records of text data.• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.• Helped business processes by developing and configuring Hadoop ecosystem components that moved data from individual servers to HDFS.

Dallas Texas

• Developed multiple Map Reduce jobs in java for data cleaning and preprocessing. • Importing and exporting data into HDFS and Hive using Sqoop. • Responsible for developing data pipeline using flume, Sqoop and pig to extract the data from weblogs and store in HDFS.• Used Oozie workflow engine and UC4 scheduling to run multiple Hive and Pig Jobs.• Experienced in managing and reviewing Hadoop log files.• Used Sqoop to import and export data from HDFS to RDBMS and vice-versa.• Created Hive tables and involved in data loading and writing Hive UDFs.• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.• Load and transform large sets of structured, semi structured and unstructured data. • Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.• Worked with systems to accept events from Kafka producer and emit into DB.• Involved in developing Hadoop MapReduce jobs for merging and appending the repository data.

Austin, Texas Area

• Worked on analyzing Hadoop cluster and different date analytic tools including Pig, Hive and Sqoop.• Created HDFS (Hadoop Distributed File System), and MapReduce jobs in java.• Implemented NameNode backup using NFS for High availability.• Involved in loading data from UNIX file system to HDFS. • Used Pig as ETL tool to do transformations, event joins and some pre-aggregations before storing the data onto HDFS.• Responsible for developing data pipeline using Sqoop and pig to extract the data from weblogs and store in HDFS.• Implemented test scripts to support test driven development and continuous integration.• Responsible to manage data coming from different sources.• Exported the analyzed data to the relational database MySQL using Sqoop for visualization and to generate reports.• Load and transform large sets of structured, semi structured and unstructured data• Experience in managing and reviewing Hadoop log files.

India