Lead Backend Engineer
Current Led the design and implementation of agentic systems and voice user interfaces (VUI) using Next.js (React based) frontends/BFFs and FastAPI backends for completions, significantly enhancing operational efficiency for work-flows.that were previously resistant to digitization and automation. Mentored engineers and did work on handling streaming data, providing example code and guidance for React-based.frontends, enabling successful integration of real-time features and improving team capabilities. Fine-tuned a Whisper medium models on synthetic data comprised of industry-specific utterances, increasing accuracy.in recognizing certain industry jargon from a baseline of ~40% to over ~80%. Deployed systems and setup CI/CD pipelines using Github Actions, Docker and AWS ECS. Designed and engineered real-time, bi-directional streaming data pipelines using WebSockets to process text/audio input, perform transcription via Whisper, leveraging OpenAI API and LLMs finetuned using DPO for reasoning, and stream responses back to clients, ensuring a highly responsive user experience. Leveraged advanced prompt engineering techniques and implemented function calling (tool use) to significantly reduce LLM hallucinations, resulting in more accurate and reliable data outputs for critical information.