Backend Engineer Intern – Data Platform
Current- Created a custom database retention policy using Airflow, Presto, and Kubernetes to purge outdated records in a Postgres metastore.
- Dynamically scaled up/down Presto clusters based on Prometheus metrics streaming data. Brought down Kubernetes hosting costs to less than $500 daily.
- Implemented developer configurable, fault tolerant, autoscaled Flink jobs.