Why p99 Gets Worse When the CPU Graph Looks Fine
A slow request may be waiting in places the average CPU graph cannot see, so follow the request before adding another worker.

Software engineer · agent quality and efficiency · ML systems
I work on agent quality and efficiency at Google. My work focuses on making agent systems faster, more reliable, and less expensive. I'm especially interested in ML inference, GPU systems, compilers, and runtimes.
I also founded Strust, an independent benchmark for code conversion and conformance in legacy modernization. I earned an MS in Machine Learning and Bioinformatics from Columbia University and two BS degrees from UC Santa Barbara: Chemical Engineering and Statistics and Data Science.
Outside of work I play cello, backpack, write, and release music as Copperbelt.
Elsewhere: software, social, research / projects, writing, music, photos.
A slow request may be waiting in places the average CPU graph cannot see, so follow the request before adding another worker.

Current work and collaborations: