Senior Sre
CurrentSupporting more than 100+ clients handling large number of production clusters.Experience in building the clusters from scratch using both packages and parcels. Installed Hadoop Clusters for Pre-prod and Prod environments.Collaborated with multiple teams for design and implementation of Hadoop clusters.Creating encryption zones in Production cluster to maintain extra level of security for customers data.Responsible for commissioning and decommissioning of nodes from Clusters.Importing and exporting data into HDFS using Sqoop.Configuring alerts from Cloudera Manager to maintain proactive monitoring of cluster health.Scheduling BDR jobs to move data from Production clusters to DR cluster.Working on Name node high availability customizing Zookeeper Services.Rebalancing the Hadoop Cluster.Involved in minor and major upgrades of Hadoop and Hadoop eco system.Allocating the name and space Quotas to the users in case of space problems and alerting space utilizations to the application teams.Configuring resource queues for tenants using DRP(Dynamic Resource Pool) configurationCreating and monitoring Pods, Deployments, Replication Controllers, ReplicaSets, DaemonSets, Services, Namespaces, Daemon sets, Static Pods using YAML script.Analysing the Pods, Container logs and cluster component logs for troubleshooting the issues.Creating new accounts for Users, Groups and added users to different groups through IAM.Creating policies and attaching it to the groups.Creating EC2 instances and attaching it to VPC and Subnets.Automating backups from shell to transfer data to S3 buckets.Building S3 buckets and managing policies for S3 buckets. Configuring and managing Security groups and VPC.Creating Dashboards and panels for confluent Kafka in Grafana with Prometheus and trigger alerts Integrating CI/CD pipelines wit Jenkins and Gitlab.Troubleshooting docker, Kubernetes and AWS related issues.
