Big Data Engineer And Analyst
Current• Involved in start to end process of Hadoop cluster setup where in installation, configuration andmonitoring the Hadoop Cluster.• Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, ClusterMonitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.• Monitoring systems and services, architecture design and implementation of Hadoop deployment,configuration management, backup, and disaster recovery systems and procedures.• Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon thejob requirement• Importing and exporting data into HDFS using Sqoop• Experienced in define being job flows with Oozie• Loading log data directly into HDFS using Flume.• Experienced in managing and reviewing Hadoop log files.• Installation of various Hadoop Ecosystems and Hadoop Daemons• Installation and configuration of Sqoop and Flume, Hbase• Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purposes.Communicate and escalate issues appropriately• As a admin followed standard Back up policies to make sure the high availability of cluster• Involved in Analyzing system failures, identifying root causes, and recommended course ofactions. Documented the systems processes and procedures for future references• Worked with systems engineering team to plan and deploy new Hadoop environments andexpand existing Hadoop clusters• Monitored multiple Hadoop clusters environments using Ganglia and Nagios. Monitoredworkload, job performance and capacity planning using Cloudera Manager• Installed and configured Flume, Hive, Pig, Sqoop and Oozie on the Hadoop cluster• Involved in Installing and configuring Kerberos for the authentication of users and Hadoopdaemons.