Why p99 Increases While Average CPU Utilization Stays Flat
A request can accumulate queueing delay that average CPU utilization does not reveal, so measure its path before increasing the worker count.

Software engineer · agent quality and efficiency · ML systems
I work on agent quality and efficiency at Google. My work focuses on making agent systems faster, more reliable, and less expensive. I'm especially interested in ML inference, GPU systems, compilers, and runtimes.
I also founded Strust, an independent benchmark for code conversion and conformance in legacy modernization. I earned an MS in Machine Learning and Bioinformatics from Columbia University and two BS degrees from UC Santa Barbara: Chemical Engineering and Statistics and Data Science.
Outside of work I play cello, backpack, write, and release music as Copperbelt.
Elsewhere: software, social, research / projects, writing, music, photos.
A request can accumulate queueing delay that average CPU utilization does not reveal, so measure its path before increasing the worker count.

Current work and collaborations: