Naga R. Email & Phone Number

Bloomfield, Ct, Us

• Responsible for building scalable distributed data solutions using Hadoop• Imported data using Sqoop to load data from MySQL to HDFS on regular basis from various sources.• Written multiple MapReduce programs to power data for extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV & other compressed file formats.• Reviewed the HDFS usage and system design for future scalability and fault-tolerance.• Developed Hive Queries in Spark-SQL for analysis and processing the data. Used Scala programming to perform transformations and applying business logic. • Involved in loading data from LINUX file system to HDFS.• Loaded and transformed large sets of structured, semi structured and unstructured data in various formats like text, zip, XML and JSON.• Using GitHub as version control tool for code management. • Extensively using home grown application IBIS to ingest the data from one source to another main component of IBIS is Sqoop.• Defined job flows and developed simple to complex MapReduce jobs as per the requirement.Optimized MapReduce Jobs to use HDFS efficiently by using various compression mechanisms.• As Data ingestion team mainly focused on ingesting data from various databases like Oracle,Mysql,DB2 to Hadoop and Hadoop to AWS.• Extensively using python and pysaprk for the transformations of the data, wrote various glue jobs using pysprak to load the data from Hadoop to AWS S3 in the form a CSV and later loading into AWS Database Redshift.• Wrote some policies on S3 Buckets to load the data after certain period into AWS Snowflake for retrieval in later point of time.• Did a POC on Apache Airflow by writing some DAG’s to schedule the glue jobs we developed in develop environment.• Worked on Mainframe systems to schedule our data loads in production environment.• Used Amazon Web Services (AWS) S3 to store large amount of data in identical/similar repository.

Hartford, Connecticut, Us

Developed Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of data.Implemented Spark using python and Spark SQL for faster testing processing the data. Developed Spark scripts by using python shell commands as per the requirement.Involved in data modeling and sharding and replication strategies in Cassandra.Load the data into Spark RDD and do in memory data Computation to generate the Output response.Knowledge on handling Hive queries using Spark SQL that integrate Spark environment.

Oakland, California, Us

- Configured Hive and written Hive UDF's and UDAF's Also, created Static and Dynamic with bucketing- Collected the logs data from web servers and integrated in to HDFS using Flume.-Worked on different file formats like Parquette, Orc, Avro, Sequence files using MapReduce/Hive/Impala.-Worked on BI tools as Tableau to create dashboards like weekly, monthly, daily reports using tableaudesktop and publish them to HDFS cluster.

-Imported data using Sqoop to load data from MySQL to HDFS on regular basis from various sources.-Developed Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of data.-Knowledge on handling Hive queries using Spark SQL that integrate Spark environment.-Exported the analyzed data into relational databases using Sqoop for visualization and to generate reports for the BI team.-Optimized MapReduce Jobs to use HDFS efficiently by using various compression mechanisms.

Sewickley, Pa, Us

-Worked on Creation of Optimized Environment for testing and demonstrating Spark, Cassandra & Kafka.-Implemented ETL code to load data from multiple sources into HDFS using pig scripts.-Developed PIG Latin scripts to extract data from source system.-Created and maintained technical documentation for executing Hive queries and Pig scripts.-Optimizing Hadoop MapReduce code, Hive and Pig scripts for better scalability, reliability andperformance.

-Involved in creating Hive tables loading data, and writing queries that will run internally in MapReduce-Used Spark for transformations, event joins and some aggregations before storing the data into HDFS.-Monitored continuously and managed the Hadoop cluster using cloudera manager.-Expertise with NoSQL databases like HBase.

-Involved in various stages of Enhancements in the Application by doing the required analysis,development, and testing.-Involved in integration of various Struts actions in the framework.-Involved in the development of the User Interfaces using HTML, JSP, JS, Dojo Tool Kit, CSS and AJAX.