Senior Software Development Engineer
CurrentAmazon RufusMy team focuses on using Generative AI, traditional lexical/semantic search, and high-performance distributed computing to create a shopping assistant that can help customers across a wide spectrum of shopping missions. In my current role, I help lead the technical architecture, implementation, and operational excellence of a variety of work streams, which include:- Enabling internal Amazon businesses and organizations to provide runtime evidence for the underlying LLM to generate helpful shopping recommendations.- Reducing latency of the LLM responses by employing various online and offline caching strategies.- Enabling product managers and scientists to fine-tune the LLM for different shopping missions and customer use-cases to ensure accurate conversational responses.- Creating an experimentation framework and platform to help the organization rapidly iterate and learn from decisions.- Creating entirely new CXes in the Rufus layer to augment the baseline shopping experience on the Amazon mobile app.