{"i":27,"slug":"routing-at-scale","chart":{"id":"routing-at-scale-waiting-hours","title":"Waiting scenarios per day at 1 million decisions a day (calculation)","subtitle":"Decisions × time per decision, in hours of waiting added across all requests; whisker = the same calculation at the 95th percentile","kind":"bar","unit":"count","yLabel":"Waiting hours at assumed median / p95 time","whisker":"p50-p95","series":[{"name":"Hours of waiting per day","points":{"$k":["label","value","lo","hi","n"],"$r":[["Jev 1.13 (TypeSafe)",37.917,37.917,54.361,246],["Claude Sonnet 5.5 (low) · Claude Code",721.67,721.67,1193.9,82],["Claude Haiku 4.5 · Claude Code",3520.6,3520.6,9559.2,82]]}}],"note":"This is a calculation, not a run. Hours of waiting a day = decisions a day × time per decision ÷ 3,600, if each request waits for its decision. The bar uses the median time. The whisker uses the 95th percentile time and is not a confidence interval. Total waiting equals decisions × the mean time. The public extracts do not contain the mean for the CLI routers, so the true total is not known. \n\nThe rule-based policy has no bar: at this volume the median-time scenario gives 1.42 s in total. A decision outside the request’s critical path may add no waiting for that request.","sourceIds":["calc-routing-at-scale","agent-routing-overhead","agent-routing","agent-jev-live"]}}