• Configured Kubernetes clusters on AWS EKS, optimizing resource utilization and scalability for microservices architecture.• Managed Kubernetes clusters and deployed applications using Helm & YAML configurations, ensuring seamless deployment and scaling.• Implemented best practices for code integration, testing, and release management, ensuring high-quality software delivery.• Dockerized microservices and orchestrated them on K8s clusters.• Established CI/CD pipelines with Jenkins, Multibranch Pipelines and Git, reducing deployment times by 60% and ensuring code quality through automated testing with SonarQube.• Installed and configured Nexus repository manager for sharing artifacts between internal teams• Proficient in writing Terraform scripts to provision and automate cloud infrastructure, optimizing resource allocation and streamlining deployment processes.• Employed Terraform scripts to provision and automate Cloud Infrastructure.• Managed version control systems like Git and GitHub, tracking and managing changes in code, scripts, and configurations.• Configured Nexus repository manager for artifact sharing between internal teams• Collaborated with development teams to design and implement Kubernetes-based solutions, ensuring alignment with business requirements.• Designed and implemented a fully automated CI/CD pipeline, reducing deployment time by 50% and increasing deployment frequency by 75%.• Collaborated with development teams to implement infrastructure as code, resulting in a 30% reduction in infrastructure costs and a 20% increase in system reliability.• Implemented an automated solution for scaling applications on AWS, enabling the company to handle a 100% increase in traffic during peak periods without any downtime.• Demonstrated expertise in cloud security best practices, encompassing IAM, security groups (SG), to uphold data integrity and regulatory compliance.

• Building, deployment, configuration, managing, monitoring, troubleshooting and security of Big Data Production, BDR, Staging and POC clusters in AWS cloud Environment using Cloudera distribution of Hadoop.• Commissioning and Decommissioning of nodes, adding and removing services and resource optimization, performance tuning.• Implemented High Availability for HDFS, Resource Manager and load balancing of HS2 to avoid SPOF.• Conducted tuning of Spark jobs, reducing execution time by 25% and improving overall system efficiency.• Troubleshot and resolved spark issues leveraging the knowledge of Cloudera ecosystem and Linux commands ensuring 99.9% availability for mission critical data processing task.• Loading Data from HDFS to Amazon S3 and vice versa, assisting in creation of data pipeline.• Monitoring running jobs on integration and production Hadoop cluster, analyzing delayed jobs affecting the cluster.• Shadowed solution architect in decision making of cluster and capacity planning.• Hands-on experience in managing incident, problem, service request, and change management tickets in accordance with ITIL guidelines.• Hands on experience in Upgradation and Migration tasks.• Experience in analyzing log files for Hadoop Eco system services and providing root cause analysis in case of any issue.• Proficient in designing and implementation of backup and disaster recovery (BDR) solutions for Big Data Cluster ensuring 11/9 data durability.• Good knowledge in authentication through Active Directory and MIT-Kerberos, and established controlled data environments with role-based authorization using Sentry.• Performing Filesystem check and generating reports to check health status of cluster• Managing users and space quota and taking Snapshots of critical directory and files.