- Evaluated models for toxicity, jailbreaks, and prompt injections. Developed robust filtering systems for on and off-domain queries to ensure safe and reliable AI interactions.- Specialized in the internal workings of custom agents, tracing their inner iterations to optimize performance and accuracy in various applications.- Developed a co-pilot for a US-based home insurance company, enhancing customer support through intelligent automation and personalized interactions.- Created chatbots for product discovery, content creation, and conversation tuning, utilizing intent flows to deliver seamless user experiences.- Proficient in working with LangChain, vector databases, LLMs, and open-source models. Demonstrated ability to apply these technologies to real-world business challenges.- Utilized open-source libraries such as LangKit, LangSmith, PromptFoo, and TrueLens for comprehensive evaluations and telemetry.- Fine-tuned models for specific usecases as Conversational Tunning, Question-answering