Platform Engineer
CurrentAs a Platform Engineer at Cloudaeon Technologies, I have contributed to multiple key projects, specializing in integrating DevOps tools and managing large-scale cloud and Hadoop environments. My responsibilities include: Project Prophecy-M&S: Integrated low-code data engineering tools with DevOps pipelines, ensuring seamless deployments and robust automation. Cloudera SaaS Support: Provided platform support for 10+ SaaS customers, managing the configuration, administration, and optimization of Hadoop clusters (CDP 7.2.15) in cloud environments.Key Achievements: Databricks & Airflow: Deployed and administrated Databricks workspaces and Airflow on Azure, enhancing data processing and workflow automation. CI/CD Pipelines: Implemented and maintained CI/CD pipelines using GitHub Actions, streamlining the development lifecycle. Kubernetes Operations: Managed Kubernetes pod operations for log analysis and troubleshooting, improving system reliability. Cloud Operations: Handled cloud services like EC2, S3, IAM, Azure VMs, and Storage, ensuring efficient resource management and operational continuity. Hadoop Management: Oversaw the deployment, monitoring, and optimization of Hadoop clusters, including services like Hive, Impala, HDFS, and YARN. Terraform: Provisioned cloud resources on AWS using Terraform, facilitating infrastructure as code practices.Technologies and Tools: Cloud Platforms: Azure, AWS, GCP DevOps Tools: GitHub, Jenkins, Docker, Kubernetes, Terraform Data Engineering: Hadoop, Databricks Monitoring & Operations: Salesforce, Jira, Confluence