Hadoop Administrator
CurrentIn my current experience, I am part of a team of experts supporting the Cloudera platform, focused on maintaining complex Big Data environments, maintaining the availability of frameworks and their components, supporting and implementing new pipelines developed by data engineering teams.As a day-to-day premise, I seek to play the role of mentor, directing, sharing knowledge and culture absorbed from the company with my peers, as well as being open to challenges and sharing knowledge in… Show more In my current experience, I am part of a team of experts supporting the Cloudera platform, focused on maintaining complex Big Data environments, maintaining the availability of frameworks and their components, supporting and implementing new pipelines developed by data engineering teams.As a day-to-day premise, I seek to play the role of mentor, directing, sharing knowledge and culture absorbed from the company with my peers, as well as being open to challenges and sharing knowledge in new technologies by other teams of experts.Responsibilities:- Collaboration with infrastructure teams, networks, databases and business teams to ensure data availability.- Continuous infrastructure management.- Maintenance of Hadoop clusters, as well as adding and deleting nodes and also adding disks to worker nodes.- Kerberos security protocol management.- TLS/SSL encryption configuration.- Configuration of authorization and authentication of LDAP users, via Apache Sentry.- Management and monitoring of the file system.- Management and review of log files.- Automation of routines using Ansible and Shell Script.- Deployment of models, support and monitoring of batch applications.- Collaboration with multiple data teams, absorbing understanding and structuring data pipelines.- Dissemination of knowledge and direction of the technical area. Show less