Lead Engineer
CurrentDeveloped a central framework called ASTRA at Naukri.com to enable various organizational segments to harness Generative AI capabilities effectively. The system served as a gateway between multiple systems and large language models (LLMs), offering a unified endpoint for seamless model integration. This allowed effortless model switching without requiring code changes in downstream systems. Key features of the framework included rate limiting, retry and reconciliation mechanisms for failed… Show more Developed a central framework called ASTRA at Naukri.com to enable various organizational segments to harness Generative AI capabilities effectively. The system served as a gateway between multiple systems and large language models (LLMs), offering a unified endpoint for seamless model integration. This allowed effortless model switching without requiring code changes in downstream systems. Key features of the framework included rate limiting, retry and reconciliation mechanisms for failed requests, Personally Identifiable Information (PII) encryption, streaming capabilities, and an interactive playground for testing and exploring results from different LLMs. Show less