Backend Engineer Intern – Data Platform
Current• Created a custom database retention policy using Airflow, Presto, and Kubernetes to purge outdated records in a Postgres metastore.• Dynamically scaled up/down Presto clusters based on Prometheus metrics streaming data. Brought down Kubernetes hosting costs to less than $500 daily.• Implemented developer configurable, fault tolerant, autoscaled Flink jobs.