Field notes from the plumbing under LLM traffic.

Deep, specific write-ups on the infrastructure beneath large language models — distributed inference, prompt caching, and the telemetry that makes it debuggable. Read the code, run it on real GPUs, report what actually happens.