NLP Engineer working on the development of applications using Large Language Models (LLMs).Some interesting projects I have worked on:𝐄𝐟𝐟𝐞𝐜𝐭 𝐨𝐟 𝐅𝐞𝐰-𝐒𝐡𝐨𝐭 𝐏𝐫𝐨𝐦𝐩𝐭𝐢𝐧𝐠 𝐚𝐧𝐝 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧 𝐨𝐟 𝐋𝐋𝐌𝐬 𝐮𝐬𝐢𝐧𝐠 𝐭𝐡𝐞 𝐄𝐥𝐞𝐮𝐭𝐡𝐞𝐫𝐀𝐈 𝐋𝐋𝐌 𝐇𝐚𝐫𝐧𝐞𝐬𝐬:• Evaluated the generative performance of three language models - OPT, GPTNeo, and Dolly - across benchmark datasets (AI2’s Reasoning Challenge, Adversarial Natural Language Inference, and Winograd Schema Challenge) using various prompt settings: Zero-Shot, One-Shot, Three-Shot, and Five-Shot prompts.• Observed that model performance on all the benchmarks linearly scales with an increase in model size and there is a significant increase in performance as the number of few-shot (in-context) examples increases in the prompt.𝐄𝐟𝐟𝐞𝐜𝐭 𝐨𝐟 𝐎𝐩𝐭𝐢𝐦𝐢𝐳𝐞𝐫 𝐒𝐞𝐥𝐞𝐜𝐭𝐢𝐨𝐧 𝐚𝐧𝐝 𝐇𝐲𝐩𝐞𝐫𝐩𝐚𝐫𝐚𝐦𝐞𝐭𝐞𝐫 𝐓𝐮𝐧𝐢𝐧𝐠 𝐨𝐧 𝐓𝐫𝐚𝐢𝐧𝐢𝐧𝐠 𝐄𝐟𝐟𝐢𝐜𝐢𝐞𝐧𝐜𝐲 𝐚𝐧𝐝 𝐋𝐋𝐌 𝐏𝐞𝐫𝐟𝐨𝐫𝐦𝐚𝐧𝐜𝐞:• Investigated the impact of optimizer selection and associated hyperparameters on model performance during training across diverse tasks.• Evaluated the performance of five different optimizers (AdamW, RMSProp, NAG, SGD with Momentum, and SGD) on various natural language processing tasks such as Sentiment Analysis, Question Answering, and Text Summarization. Analyzed the convergence of the best-performing models on each dataset.• Fine-tuned DistilBERT, BERT, and FinBERT models for Sentiment Analysis on the StockTwits dataset, while DistilBERT, BERT, RoBERTa were fine-tuned for Question Answering on the CoQA dataset. For Text Summarization, BART, DistillBART, and T5 models were fine-tuned on the BillSum dataset.• Empirical observations highlighted that more general optimizers like RMSProp and AdamW consistently performed as well as, if not better than, specialized optimizers like SGD, Nesterov, or Momentum, given appropriately selected hyperparameters.Active contributor to multiple popular open-source projects.𝐆𝐢𝐭𝐇𝐮𝐛: https://github.com/awinml𝐓𝐞𝐜𝐡𝐧𝐢𝐜𝐚𝐥 𝐬𝐤𝐢𝐥𝐥𝐬:• Languages: Python• Machine Learning: Numpy, Pandas, Scikit-learn, Keras, PyTorch• NLP: Hugging Face Transformers, HaystackOpen to interesting conversations and collaboration, happy to connect.𝐄𝐦𝐚𝐢𝐥: ashwinxmathur@gmail.com