Machine Learning Engineer
CurrentLed the end-to-end development of a voice-based AI hardware device that enables children to craft interactive stories, generate digital artwork, and compose original music through natural conversation.• Architected and implemented an end-to-end voice-based interaction system leveraging Google Cloud Platform for LLM orchestration• Engineered a low-latency cloud infrastructure for streaming Text-to-Speech (TTS) audio outputs using websockets, enhancing user experience• Implemented comprehensive testing frameworks to monitor LLM accuracy and maintain prompt engineering stability• Leveraged and fine-tuned LLaMA 70B model for robust tool-calling capabilities• Optimized TTS performance using TensorRT, significantly improving end-user experience