Aarush Sah Email & Phone Number

California, United States

California, United States

Palo Alto, California, United States

- Created Groq's internal framework for model quality evaluations from scratch, and now lead its development- Created Groq's internal framework for measurement of throughput and performance from scratch, and now lead its development- Creating and maintaining monitoring systems for Groq's API infrastructure with an emphasis on model quality- Representing Groq at multiple bay area tech events and judged hackathons like CalHacks- Integrating Groq into popular open-source LLM frameworks in my spare time

Palo Alto, California, United States

- Built an LLM performance testing framework from scratch- Helped fix critical reliability issues in Groq's inference stack- Helped optimize compiles of models on Groq's LPU systems for maximum throughput- Collaborated with the UK AI Safety Institute to integrate Groq into Inspect, an LLM evaluation framework used by Anthropic, Google Deepmind, and other labs- Represented Groq at multiple events in the SF and Bay Area tech scene, judging multiple hackathons, including the 2024 UC Berkeley AI Hackathon

Synthetic data generation pipelines for instruct-tuning large language models