Research Assistant
● Conducted comprehensive literature reviews to remain updated on the latest advancements in LLMs, automated program repair, and associated optimization techniques.● Fine-tuned Large Language Models (LLMs) such as Codellama, PLBART, Refact, CodeGen, and CodeT5 for Automated Program Repair (APR) tasks, employing techniques including PEFT (Parameter Efficient Fine-Tuning), LoRA (Low-Rank Adaptation), and int-8 optimization.● Implemented and optimized LLMs using state-of-the-art methodologies, ensuring compatibility with resource-constrained environments through various optimization methods like Gradient Checkpointing, int-8 optimization, etc.● Utilized SLURM to manage and distribute computing tasks across multiple GPUs, optimizing model training and experimentation efficiency.