Data Scientist
CurrentProfile Summary:-Experienced professional at a leading U.S.-based AI organization specializing in developing and optimizing large language models (LLMs).-Expert in model evaluation, identifying strengths and weaknesses, and employing strategic data to bridge gaps.Key Responsibilities:-Conducted in-depth evaluations of model performance, focusing on continuous improvement.-Enhanced coding capabilities across various programming languages using high-quality training data… Show more Profile Summary:-Experienced professional at a leading U.S.-based AI organization specializing in developing and optimizing large language models (LLMs).-Expert in model evaluation, identifying strengths and weaknesses, and employing strategic data to bridge gaps.Key Responsibilities:-Conducted in-depth evaluations of model performance, focusing on continuous improvement.-Enhanced coding capabilities across various programming languages using high-quality training data for -Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF), (Low-Rank Adaptation)LORA and (Quantized Low-Rank Adaptation)QLORA.-Developed data-driven solutions for function calling and agent workflows utilizing APIs across platforms such as Azure, iOS, GCP, AWS, Salesforce, and ServiceNow.-Provided comprehensive post-training support to optimize models using techniques like SFT, Multilingual Fine-Tuning (MFMT), RLHF, and Direct Policy Optimization (DPO).-Measure the performance of LLM using performance metrics such as BLEU, ROUGE, MAUVE, SacreBlEU, etc.Technical Contributions:-Led training initiatives for LLMs to address data structure and algorithm (DSA) coding challenges.-Spearheaded the integration of LLMs with external data sources and APIs to enhance functionality and data accessibility.-Identified and corrected behavioral errors in LLM outputs, creating specialized datasets to target specific error patterns and prevent recurrent issues. Show less