Site Reliability Engineer
Current- As a part of the Data Platform Team, we are responsible for managing Kafka, Hadoop & Airflow Infrastructure. Our Central Kafka & Hadoop clusters is being used across the organization and is critical for revenue and analytics across Media.net’s adtech business.- Responsible for active development of Kookaburra, an internal Python application which monitors, alerts and self-manages Kafka Clusters.- Responsible for managing infrastructure across GCP, Akamai & our Private DC. This… Show more - As a part of the Data Platform Team, we are responsible for managing Kafka, Hadoop & Airflow Infrastructure. Our Central Kafka & Hadoop clusters is being used across the organization and is critical for revenue and analytics across Media.net’s adtech business.- Responsible for active development of Kookaburra, an internal Python application which monitors, alerts and self-manages Kafka Clusters.- Responsible for managing infrastructure across GCP, Akamai & our Private DC. This included Kubernetes Clusters, Akamai CDNs, VMs, Load Balancers and ArtifactRegistry.- Crucial in setting up our first MLOPs pipeline with KubeFlow on our internal Kubernetes Cluster.- Migrated all of our CI/CD pipelines from Jenkins to Gitlab CI, for better developer experience.- Instrumental in setting up ArgoCD, for managing workloads across Kubernetes Clusters.- Migrated Alerting and Monitoring from Icinga2 to Prometheus Alerting Stack.- Setup a Runbook for commonly occurring production issues. Show less
