Sr. Ai Product Manager - Education Platform (Ai Lab)
Shanghai, China
As a member of ByteDance AI Lab, I was one of two product manager working with different business unit to utilize Bytedance AI capabilities for Educational Products in the post EdTech double reduction in China. ■ English Language CAT learning placement test and learning recommendation optimization- Defined key metrics for placement test success. (CEFR Placement Accuracy 26% increase by IRT modal)- Average questions answered lowered by 33% compare with previous placement test.- 10% Increase in full course purchase conversion for 10 day trial course. - student retention increased 10% for first 14 days of learning.- learner NPS increased by 16%. ■ Scenario based AI oral & listening English language proficiency CAT assessment.- Conducted English language speaking assessment product research and roadmap planning. (ETS SpeechRater & Duolingo English Test)- Delivered CAT scoring engine (human vs machine score Pearson corr > 0.71)- Collaborated with linguistic experts, psychometrician and AI engineers on the development of automated oral language scoring engine. (Features include: Semantic Quality, Lexical Diversity, Lexical Accuracy, Syntactic Accuracy, Syntactic Diversity, Prompt Adherence, and Text Formality)