Hemant Kumar Email & Phone Number

Redmond, Washington, Us

• Lead the engineering organization that builds the Microsoft Inference Cloud, one of the largest inference platform that delivers SaaS inferencing with large language models (LLMs) on multi-billion dollar GPU capacity.• Inference cloud provides LLM APIs for all Microsoft Copilots, Azure OpenAI, and ISV hosted models like Llama, Mistral, Cohere, and others, with a unified and consistent experience for customers and developers.• Drove the vision, strategy, and execution of Inference Cloud delivering inferencing as a SaaS offering, collaborating with internal and external stakeholders, product managers, and architects.• Delivered 36% cost efficiency for LLM inferencing within a short time by optimizing resource utilization, reducing fragmentation, and scheduling workloads.

Redmond, Washington, Us

• Built multiple new service offerings and scaled Cosmos DB service 100x.• Delivered a compute platform for Cosmos DB service to run compute-intensive, dedicated and multi-tenant workloads like gateways, caches, Mongo and Cassandra translation engines.• Developed Cosmos DB Database accelerator for ultra-low latency, cost-optimized data access.• Architected enterprise security features such as PrivateLink, RBAC, Firewall, and Network Isolation.• Ensured customer success on Cosmos DB.

Redmond, Washington, Us

• Enhance the voice and messaging capabilities of Teams and provide a seamless experience for users across devices and platforms leveraging Talko features post-acquisition.• Talko was a mobile app that enabled team communication through voice, text, and photos. It was acquired by Microsoft in 2015 and its features were integrated and extended into Microsoft Teams.

Built cloud services for mobile collaboration startup* Architecture, design and implementation of Messaging and Calling service at Talko on AWS and Azure.* Service features: Sync, Push notifications, Slack integration, Web auth, Call export, User status, Service support for materialized views.* Designed and developed monitoring and alerting infrastructure for Talko service.

Redmond, Washington, Us

Built Azure Load Balancer from ground upDesigned and created Software Load Balancer (SLB) for Azure from inception to key platform enabling Azure growth.* SLB is a massively distributed system running on all nodes in Windows Azure cloud. Multiple instances of SLBs are deployed in Azure and had a combined capacity of multiple Pentabytes per second. (Description in ACM SIGCOMM 2013 paper: Ananta: Cloud Scale Load Balancing)* Invented and implemented novel mechanism to reduce data path latency by more than 50% and increase throughput by 100x for intra-region Azure traffic. (Details in section 3.2.4 of above paper.)* Scaled SLB to 50 TBps

Redmond, Washington, Us

* P2P mesh transport protocol.* Notification engine for Live mesh client app.

Redmond, Washington, Us

Built new TCP/IP stack for Windows* Core TCP/IP protocol dev.* IPsec acceleration for Windows.* Perf benchmarking and improvement for crypto suite used by IPsec.* Windows filtering platform.

Dallas, Tx, Us

Consultant on Network Architecture and Voice over IP

Created an image processing app to enable low bandwidth whiteboard based video conferencing.

Ms, Ece

Bachelor Of Technology - Btech, Electrical And Electronics Engineering