Siyang Li Email & Phone Number

Mountain View, Ca, Us

GenAI Efficiency: improve LLM model efficiency to reduce latency, TPU/GPU cost etc- Distributed KV cache to reduce cost and latency, including implicit prefix caching and explicit context caching, see https://ai.google.dev/gemini-api/docs/caching2024 Q3 Perfy Gold Award in EEVEE (efficient estimation and verification with early exist) to speed up LLM decoding steps by 1.5x-2x with similar output quality and lightweight training

Mountain View, Ca, Us

Smart Alerting: prevent and detect outages to protect Google ads revenue via monitoring and alerting of critical metrics. Tech lead in anomaly detection and alerting systems. - Have experience building monitoring infrastructure from scratch (0->1) and dramatically improving performance metrics (1->N). Raised precision outage from 16.34% to 27.06% in 1 quarter while maintaining recall outage ~80%; Conducted data-driven experiments to increase monitoring coverage from 43% to 95% in 1 year; Increased the detection scope from 19 to 40+ teams in 1 year with recall outage ~80%.- Proposed a strategy plan to reduce alert toil, analyzed production alerts to identify the highest ROI features, developed the roadmap, and led 4 engineers to deliver expected results- Collaborated with EngProd and SRE teams in project executions, guided 2 external engineers to build the unified alerting systems across Ads2021 Q1 Perfy Silver Award in optimizing click loss Flume pipeline. 3.11 faster, 80%+ resource savings and able to support 20.4x data growth without performance degradation2023 Q3 Perfy Bronze Award in optimizing Seasalt Flume pipeline. Reduced pipeline post-aggregation latency from 8 hours to 1 hour2024 Q3 Perfy Bronze Award in improving Seasalt Flume pipeline scalability and latency. Reduced the 3-year simulation latency from > 3 days to 7 hours

Seattle, Wa, Us

AWS Networking: help customers manage networking infrastructure on the cloud via a unified platform with standardized APIs- Cooperated with network engineers to design and implement Corkscrew, an internal tool to apply encryption keys to the links. Onboarded Nexus7K, Nexus9K, Ciena WaveServer, and Knox device platforms- Proposed solutions to the encryption key application delay issues and scaling issues in fetching encryption observed states- Implemented encryption staleness auditing to detect links with a time gap from the last key rotated time greater than the encryption staleness threshold and automatically alarm to auto-remediation system

San Francisco, Ca, Us

Master’S Degree, Information Systems Management, Business Intelligence And Data Analysis

Bachelor'S Degree