Aarush Sah Email & Phone Number

California, United States

Palo Alto, California, United States

- Created Groq's internal framework for model quality evaluations from scratch, and now lead its development- Created Groq's internal framework for measurement of throughput and performance from scratch, and now lead its development- Creating and maintaining monitoring systems for Groq's API infrastructure with an emphasis on model quality- Representing.

Palo Alto, California, United States

- Built an LLM performance testing framework from scratch- Helped fix critical reliability issues in Groq's inference stack- Helped optimize compiles of models on Groq's LPU systems for maximum throughput- Collaborated with the UK AI Safety Institute to integrate Groq into Inspect, an LLM evaluation framework used by Anthropic, Google Deepmind, and other.

Synthetic data generation pipelines for instruct-tuning large language models