Senior Machine Learning Engineer
CurrentJobCall: LLM Enabled Real-Time Conversational Bot• Utilized OpenAI Whisper for speech-to-text and GPT-4 for real-time language understanding.• Integrated Twilio for real-time call management, processing raw audio signals via WebSocket, and employed ElevenLabs for natural text-to-speech.• Replaced existing IVR system, automating tenant issue handling and work order creation using function calling, dynamic prompt injections, and custom knowledge management.•Deployed scalable solutions using Docker, GitHub CI/CD Workflows, and Kubernetes, supporting 60+ properties.BillRoute: Invoice Processor• Applied business guardrails and multi-modal LLM capabilities to automate invoice processing and routing.• Various advanced LLM prompting techniques applied such as function calling, custom PDF text 2D positional representation for enhanced prompting, custom business logic validations, etc.• Integrated with Gmail API and Accounts Payable system (Coupa) to scan vendor invoices and process 1500+ invoices per month.• Deployed scalable solutions using Docker and Kubernetes with a CI/CD workflow, supporting 60+ properties.IDCore: Vendor Compliance Tool• Implemented an ensemble of CV models to achieve reliable document intake automation : combination of object detection to pair with business logic, open-source OCR solution, and multi-modal vision capability.• Ensured reliability of OCR solutions against various real-world data scenarios, including scanned documents, different formats, and custom templates.• Automated document intake for certificates of insurance and other complex documents.