- Responsible for developing & implementing end to end solutions using Hadoop, Spark,Flume, Hive, Pig, Sqoop, Cassandra, HBase, MongoDB, spark, zookeeper, AWS.- Installed/Configured/Maintained Apache Hadoop clusters for application development andHadoop tools like Hive, Pig, HBase, Zookeeper, and Sqoop.- Managed 350+ Nodes CDH 5.2 cluster with 4 petabytes of data using Cloudera Manager andLinux RedHat 6.5.- Developed data pipeline using Flume, Sqoop, Pig, and Java map-reduce to ingest customerbehavioral data and financial histories into HDFS for analysis.- Involved in collecting and aggregating large amounts of log data using Apache Flume andstaging data in HDFS for further analysis.

-Contributing as a member of a high performing, agile team focused on next-generation data& analytics- Build Big Data Analytics and Visualization platform for handling high-volume batchorientedand real-time data streams- Involved in ingestion, transformation, manipulation, and computation of data using StreamSets, Kafka, Spark.- Implemented complex big data with a focus on collecting, parsing, managing, analyzing, andvisualizing large sets of data to turn information into business insights using multipleplatforms in the Hadoop ecosystem

- Partnered with ETL developers to ensure that data is well cleaned, and the data warehouseis up to date for reporting purposes by Pig.- Selected and generated data into csv files and stored them into AWS S3 by using AWS EC2and then structured and stored in AWS Redshift.- Involved in integration of Hadoop cluster with spark engine to perform BATCH and GRAPHXoperations.- Performed data pre-processing and feature engineering for further predictive analyticsusing Python Pandas.