Omkar Gadute Email & Phone Number

Pune, Mh, In

Bengaluru, Karnataka, India

Work ExperienceIn-House Generative AI Tool• Developed a proof of concept for a conversational AI tool, integrating Large Language Models (LLMs) and Retrieval Augmented Generation (RAG) for enhanced interaction with proprietary data, promising in huge reduction of operating cost.• Engineered a custom LLM orchestration framework, seamlessly integrating document loading, embedding models, and context retrieval, using tools such as unstructured.io, e5-large, Weaviate, Llama2… Show more Work ExperienceIn-House Generative AI Tool• Developed a proof of concept for a conversational AI tool, integrating Large Language Models (LLMs) and Retrieval Augmented Generation (RAG) for enhanced interaction with proprietary data, promising in huge reduction of operating cost.• Engineered a custom LLM orchestration framework, seamlessly integrating document loading, embedding models, and context retrieval, using tools such as unstructured.io, e5-large, Weaviate, Llama2, and Mistral.• Migrated from custom frameworks to standardized frameworks like LlamaIndex and LangChain, ensuring scalability and reliability for production use.• Enhanced the RAG Framework with features like hybrid search, reranking of chunks, and improved input parsing, significantly improving response quality and accuracy of complex document queries from 50% to 70%. • Contributed to bug fixes and feature enhancements in LlamaIndex and LangChain, particularly in Weaviate implementation and streaming for HuggingFacePipeline. • Introduced meta-data filtering on top of RAG which reduced the query time by 30%. • Optimized the prompt templates and introduced custom prompt templates allowing user full control and reduction in per token cost by 20%.Innovation Team • Automated manual tasks and checks performed by support teams using selenium to reduce the operating cost by 20% and allowing the support teams capitalize on more pressing matters. • Designed and implemented an on-click solution on AWS Lambda, reducing Active Directory group processing time by 75%. Integrated message queuing and an ITSM tool for real-time notifications and tracking of habitation requests and approvals.• Developed Autosub, a Python-based solution utilizing OpenAI's Whisper model, to automatically generate subtitles for videos without captions, improving accessibility for the PWD community. Show less

India

- Web Development: We first had training for 1 month on web development technologies such as Bootstrap, Django, HTML, CSS and JavaScript.- Then we worked on a project of Course registration website in teams of 5. I contributed on the Back-End of the project which was to manage the website with Django.

Bachelor Of Technology - Btech, Computer Science, 8.64 Cgpa

12Th, Science(Pcm)

11Th, Science(Pcm)

10Th

Activities and Societies: Vice - Sports Captain