{"i":27,"slug":"routing-at-scale","chart":{"id":"routing-at-scale-in-flight","title":"In-flight scenarios at 10,000 to 10 million a day (calculation)","subtitle":"Decisions per second × assumed time per decision; bar = median time, whisker = the same calculation at the 95th percentile. The in-process policy is in the table","kind":"grouped-bar","unit":"calls","yLabel":"In-flight scenarios at median / p95 time","whisker":"p50-p95","series":{"$k":["name","points"],"$r":[["Jev 1.13 (TypeSafe)",{"$k":["label","value","lo","hi","n"],"$r":[["10,000 a day",0.015799,0.015799,0.02265,246],["100,000 a day",0.15799,0.15799,0.2265,246],["1 million a day",1.5799,1.5799,2.265,246],["10 million a day",15.799,15.799,22.65,246]]}],["Claude Sonnet 5.5 (low) · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["10,000 a day",0.30069,0.30069,0.49745,82],["100,000 a day",3.0069,3.0069,4.9745,82],["1 million a day",30.069,30.069,49.745,82],["10 million a day",300.69,300.69,497.45,82]]}],["Claude Haiku 4.5 · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["10,000 a day",1.4669,1.4669,3.983,82],["100,000 a day",14.669,14.669,39.83,82],["1 million a day",146.69,146.69,398.3,82],["10 million a day",1466.9,1466.9,3983,82]]}]]},"note":"This is a calculation, not a run. In flight = decisions a day ÷ 86,400 × time per decision, at a steady rate over 24 hours. The bar uses the median time. The whisker uses the 95th percentile time and is not a confidence interval. These are assumed-time scenarios. Actual average concurrency requires the mean time. \n\nThe inputs table lists the times. Jev ran over direct HTTPS and the Claude routers ran through a CLI, so the routes differ. Traffic has peaks, so multiply by the peak rate ÷ the average rate to size a peak. \n\nThe rule-based policy has no row. It runs in process, so at 1 million decisions a day the median-time scenario gives 0.000016 decisions in flight, a small share of one decision and not a connection. Labels round small values. The grid table lists every value.","sourceIds":["calc-routing-at-scale","agent-routing-overhead","agent-routing","agent-jev-live"]}}