Data Scientist (Genai, Llms, Ml)
CurrentI am developing END-to-END GenAI/LLM/ML products, including RAG, question answering, conversational AI (Chatbots), text summarization, named entity recognition (NER), text classification, sentimentanalysis, and machine translation. Projects:1st Project: Created an End‑to‑End Advanced Retrieval Augmented Generation (RAG) Chatbotbased on query expansion (prompt engineering), ensemble retrieval, and reranker. Results: Reduced hallucinations from 20% to 5%, and latency from 100s to 15s. Tools: LangChain, Unstructured, ChromaDB/FAISS, HuggingFace, Docker, AWS EC2, Git, and Streamlit/FLASK.• 2nd Project: Created an End‑to‑End LLM web‑app for retail searching products via fine‑tuning GPT‑3.5 Turbo and coupling it with SQL database using Langchain. I used FastAPI and Jinja for web‑interface, and deployed the web‑app on Azure with CI/CD on GitHub actions.• 3rd Project: Developed an End‑to‑End Generative AI web‑app based on google‑flan‑t5‑base LLM and prompt engineering to answer questions given document contexts. I utilized the following packages: Langchain , FAISS, HuggingFace, Docker, AWS EC2, GitHub action, and Streamlit.• 4th Project: Developed an End‑to‑End LLM web‑app via LaMini‑Flan‑T5‑248M to perform text summarization of PDF contexts, using HuggingFace, Langchain, Docker, AWS EC2, Github action (CI/CD), and Flask.• 5th Project : Pretrained a sparse transformer variant for sequence modeling based on local attention. Results: A remarkable 78% reduction in the FLOPs computation time compared to the vanilla attention. The model gives 2.8 Perplexity (PPL) in evaluation (on text_8 benchmark), and generates a novel coherent text for up to 100 tokens.