Currently working on Marketing Personalization Algorithms

-Technical Lead for Marketing Personalization Algorithms team, lead development for multiple user-facing machine learning products, planning, managing dependencies and cross functional stakeholder communications, drive prioritization, process, and delegating tasks, mentor junior members of the team.-Founding member of team, led initial projects from inception to implementation, successfully advocated for additional resourcing and investment into product area.-Developed and productionized Udemy’s discount level personalization system. Machine learning model optimizing user spend over various discount levels led to over $Xmm in annualized sitewide impact. Conducted novel market level experiment design using Difference-in-Difference analysis to identify impact on logged out users.-Leveraged causal / heterogenous effect modeling techniques to dynamically assign users personalized email type recommendations driving significant revenue impact. Worked with stakeholders to implement ongoing data collection functionality for new email types.

Experiment Science-Overhauled A/B system, overhauled metrics pipelines and analysis, standardized decision making, high quality self serve documentation + summary results, increased velocity, robustness, and executive trust in results.-Led internal deep dive sessions into A/B testing, Experiment University, practical and theoretical, created notebooks and video lectures, promoted best practices.-Implemented Bayesian optimization framework for experiment analysis.-Designed and implemented method for scaling in-experiment treatment effects to total sitewide revenue for cross exp comparisons, became standardized KPI for OKRs and executives.-Developed automated sample size and power analysis tooling, led to decrease in ad hoc requests and improved and streamlined experiment design.Product Analytics-Conducted deep dive analysis into repurchase behavior, developed repurchase regression model, identified proxy metrics, evangelized and drove adoption of proxies as team KPIs.-Onboarded data scientists as lead data scientist, implemented prioritization process across various product areas, scoped prioritized and delegated work. Primary partner for teams across udemy: Payments, Discovery, Mobile, Recommendations, Instructor, etc.-Partnered closely with Product and drove decision making on free-to-paid user conversion initiatives that drove significant company revenue.-Created tooling for B2B Sales team to identify company spend on platform, high adoption, became a core element of our sales team’s cold call pitch, cited as factor in several big deals.