Patrick Lee Email & Phone Number

New York, Ny, Us

San Francisco, California, Us

Helped develop and implement a novel method for utilizing Large Language Models (LLMs) by creating a custom Domain Specific Language (DSL) and both prompting large models and fine-tuning open source models to convert user utterances to code.Starting with models from OpenAI, we created dynamic prompts utilizing a Retrieval-Augmented Generation (RAG) approach to populate few-shot examples. Then executing the code generated by the LLM in our custom built interpreter.Moved to fine-tuning open source models with a fully synthetic dataset, that was generated, cleaned, and validated using custom built tooling.Deployed inference infrastructure on AWS to serve the fine-tuned model. Improved inference speed 3.5x over GPT-4 Turbo for a snappier user experience.Created an extensive set of evaluations to prevent regressions and to ensure LLM output met some basic criteria.Implemented additional strategies to improve LLM output, namely an agentive flow to repair malformed output and most-common generation strategies to improve model certainty.

New York, Ny, Us

Spearheaded the growth of the engineering team from 3 to 30 members over three years, directly leading 3 teams with 15 direct reports, significantly enhancing team capacity and experimental output.Established comprehensive training, hiring, and promotion pipelines and policies, fostering professional growth and leadership development within the team.Pioneered initiatives that optimized the team's mandate to fuel product innovation by enhancing experimentation velocity, achieved by implementing targeted training and efficient workflows, substantially increasing team output.Strategically designed and launched “Meristem v2”, a next-gen experimentation platform that addressed critical bottlenecks present in v1 to increase experimentation velocity to a record of 30 tests per weekEngineered the "Linear Buyflow Framework", a bespoke frontend web framework that enabled rapid, modular experimentation and iteration.

New York, Ny, Us

Lead two teams, with a total of 6 direct reports, steering them toward exceeding set ambitious business goals through technical leadership and direct one on one mentorship.Established and refined team workflows and processes, enhancing feature delivery speed and productivity.Orchestrated the launch of "Meristem", an advanced experimentation platform, optimizing the experimentation workflow by utilizing Git branches for efficient management of experiment variations.

New York, Ny, Us

Led extensive A/B testing at Noom, driving product innovation and user engagement improvements.Collaborated with Product and UX teams, identifying growth areas and leading key projects as interim Product Manager.Managed noom.com's transition from Django to React, enhancing site performance and user experience.

New York, Ny, Us

Founded Collate Notes. A electron-based note taking app that supported file-first note taking with markdown files. The goal of Collate Notes was to make sure you were in charge of your notes and to make them durable and long lasting by using a collection of markdown files as the main repository of data. We were featured in Life Hacker

New York, Ny, Us

Maintained high-profile author websites at Crown Publishing, boosting digital presence and reader engagement.Led quality assurance and process optimization initiatives, significantly enhancing usability, functionality, and fostering a culture of efficiency and innovation.

New York, Ny, Us

New York, Ny, Us

New York, Ny, Us

New York, Ny, Us

Bachelor Of Arts (B.A.), Economics-Mathematics

Associates, Business Management