ENGINEERING
How we cut agent inference latency to 82ms
A look inside the scheduling, caching, and routing work that took our median agent response time below the 100ms...
ENGINEERING
Shipping reliable tool-calls at scale
How we cut tool-call failures by 9× with typed schemas and retries.