Samuel Nikhilson Email & Phone Number

Hyderabad, In

Hyderabad, Telangana, India

Chennai, Tamil Nadu, India

This project dealt with improving IT data usage by building a robust unified data source for data exploration purposes and easy retrieval of critical information. The platform is built on the Hadoop ecosystem with HDFS being the primary data storage.Managed transformation of data from source to destination system.Gathered user business requirements by meeting business users and generated business models and use cases.Strong in understanding the business requirements with excellent verbal and written communication skills.Created Alteryx workflow to move data from Hadoop cluster to other sources.Developed HIVE queries to view data in HDFS in tabular format.Established connection between java native clients and Hadoop.Involved in doing POC's for integrating GitHub with Hadoop.Hands-on experience in developing and deploying enterprise based applications using major Hadoop ecosystem components like Map Reduce, Hive, Sqoop, Spark SQL and Oozie.Involved in Optimization of Hive Queries.Involved in Data Ingestion to HDFS from various data sources.Extensively used Apache Sqoop for efficiently transferring bulk data between Apache Hadoop and relational databases.Automated sqoop, hive and pig jobs using Oozie scheduling.Created and maintained technical documentation for executing Hive queries and Oozie jobs.Worked on debugging and performance tuning of Hive jobs.Used Oozie to schedule various jobs on Hadoop cluster.Used Hive to analyse the partitioned and bucketed data.Involved in the servers migration from Hortonworks to Cloudera.Adequate knowledge of Scrum, Agile and Waterfall methodologies.Collaborated with the subject experts whenever necessary to analyze the existing system, to determine the impact on business rules, to determine the delta between existing and proposed system, perform gap analysis to relate it to the target and to document business requirements effectively.