Rahul Sachdeva Email & Phone Number

 Collaborated with various team & management to understand the requirement & design the complete system Created Hive workflow jobs for scheduling queries & actions Involved in the end to end deployment process Following established coding standards and techniques and assist with establishing standards Design, plan, and develop programs to perform automated extract, transform and load data between data sources when working with large data sets (TBs+ range) Work directly… Show more  Collaborated with various team & management to understand the requirement & design the complete system Created Hive workflow jobs for scheduling queries & actions Involved in the end to end deployment process Following established coding standards and techniques and assist with establishing standards Design, plan, and develop programs to perform automated extract, transform and load data between data sources when working with large data sets (TBs+ range) Work directly with external vendors to resolve issues & perform technical tasks Involved in review of functional and non-functional requirements. Developing Scripts and Batch Job to schedule various Hadoop Program. Written Hive queries for data analysis to meet the business requirements. Creating Hive tables and working on them using Hive QL. Involved in creating Hive tables loading with data and writing hive queries which will run internally in map reduce way. Supported in setting up QA environment and updating configurations for implementing scripts.  Installed and configured MapReduce, Spark, Hive, Hbase and the HDFS; implemented CDH Hadoop cluster on Oracle BDA system. Assisted with performance tuning and monitoring. Adding new nodes to existing cluster and recovering from Namenode failures.  Experience in Troubleshooting and Debugging runtime issues of Hadoop and Spark clusters. Handled tuning and monitoring of Hadoop Cluster. Enabling High Availability for HDFS, Yarn and Hive. Troubleshooting Spark job issues. Performance tuning of Spark cluster. Worked on NoSQL databases like HBase, Couchbase etc. Diagnosing and resolving HBase health issues. Experience in creating HBase Snapshots and recovering data from snapshots. Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability Patching Linux virtual machines. Developed python and shell scripts for data cleaning and preprocessing. Show less

Noida Area, India

 Administered and monitored Big Data clusters and maintaining Hadoop ecosystem components HDFS, Oozie, Hbase, Spark and other services through Cloudera distributions. Performance tuning of Hadoop clusters and Hadoop MapReduce routines. Performed daily health check on servers, keeping system memory and other space in check for proper functioning. handle automatic alerts received from servers and perform required troubleshooting on Linux platform.