Staff Data Engineer
CurrentCurrently building data observability platform for offline ML models, including complete upstream and downstream lineage reporting & escalation. Defined site-up metric for delivery of scoring data, including availability and signal quality, with training frequency and historical contract performance as diagnostic signals.Defined Data org’s dataset site-up metric (Uptime) as our north star and wrote a contract validation & monitoring system. Alerting system reduces noise and toil for on-call, cascading reports for teams up through executive leadership. This system monitors both more tables and views, across more fabrics (internal cloud and Azure), in more data formats, more regularly (hourly instead of daily) than a previous solution built by Engineering org.