Lead Product Manager, Generative Ai, Evals
CurrentLead Product Manager, Generative AI- Served as a Llama lead and Product Head of Evaluations for the new Generative AI group building cutting-edge Llama models (downloaded 300MM+ times for open-source, used in products like Meta AI, growing from 10M to 500MM+ customers).- Built our entire LLM evaluation systems for data, training, and inference, growing from a 3-person team to 60+ engineers and 230+ XFN, including annotators, privacy/legal, DS/DE, etc. (counterparts were eng and DS directors).- Ran the training programs for all AI & ML product managers inside Meta, to upskill the entire PM workforce of 400+ AI PMs.[Prior] Group Product Manager, Monetization AI- Managed an 8-person product management team supporting 480 research engineers and 90+ XFN developing cutting-edge machine learning models for ads ranking and optimization across all of Meta’s apps, serving 4BN people (counterparts were 2 eng directors and 1 DS director).The Monetization Ranking team was responsible for 2/3 of Meta’s revenue growth from 2016 to 2022. It is the largest ML team inside Meta, and probably the 2nd largest in the world (after Google Search and Ads).