Research Assistant
CurrentAs a physics major, I'm interested in studying emergent phenomena in LLMs and leveraging insights for efficient training and inference. There are two ongoing directions.(1) Emergence of high-level concepts : during training and applying mechanistic interventions during inference for desired outcomes. (2) Understanding Neural Scaling law in LLMs, and how to engineer them for more efficient training and inference, as in my projects.