{"i":15,"comparison":{"slug":"deterministic-routing-policy-vs-claude-haiku-4-5","a":"deterministic-routing-policy","b":"claude-haiku-4-5","title":"Deterministic routing policy vs Claude Haiku 4.5","seoTitle":"Deterministic routing policy vs Claude Haiku 4.5: benchmarks","description":"Deterministic routing policy vs Claude Haiku 4.5: 2 measured metrics from one study (Time to make one routing decision; more), with sample sizes and intervals.","verdict":"Deterministic routing policy and Claude Haiku 4.5 share 2 measured metrics and 4 list-price calculations from one study. Deterministic routing policy leads on 1 row: Time to make one routing decision, 1.42 µs vs 12,543 ms. On those rows the p50–p95 bands do not overlap; only a 95% interval is a confidence interval. The other rows are 1 tie and 4 unclear; each row says why. Calculation rows are derived from list prices and recorded counts; they are not bills or runs.","rows":{"$k":["metric","aValue","bValue","unit","aDisplay","bDisplay","winner","basis","studySlug","chartId","aN","bN","aContext","bContext","rangeKind","spanKind","aRange","bRange","calculation"],"$r":[["Time to make one routing decision",0.00142,12543,"ms","1.42 µs","12,543 ms","a","Claude Haiku 4.5’s median is above Deterministic routing policy’s 95th percentile (p50–p95 bands: Deterministic routing policy 1.42 µs to 2.33 µs; Claude Haiku 4.5 12,543 ms to 34,481 ms); not a confidence interval.","routing-overhead","router-overhead-decision-latency",20000,82,"Agent · in process · routing overhead per decision","thinking on · via Claude Code · routing overhead per decision","range","p50-p95",[0.00142,0.00233],[12543,34481],"\u0001"],["Routing calls that returned a decision",1,1,"rate","100% (20000/20000)","100% (82/82)","tie","The 95% intervals overlap (Deterministic routing policy 100% to 100%; Claude Haiku 4.5 96% to 100%), so this sample cannot separate them.","routing-overhead","router-overhead-completed",20000,82,"Agent · in process · routing overhead per decision","thinking on · via Claude Code · routing overhead per decision","ci95","ci95",[0.9998,1],[0.9552,1],"\u0001"],["Added routing cost per 1,000 tasks (calculation) (Every model call routed (49.5 per task))",0,441.74,"usd","$0.00","$441.74","unclear","No interval or range was recorded for either side, so the gap ($0.00 vs $441.74) is not tested against run-to-run variation.","routing-overhead","router-overhead-cost-per-1000-tasks","\u0001","\u0001","Agent · in process · calculation per 1,000 tasks from recorded decision counts","thinking on · via Claude Code · calculation per 1,000 tasks from recorded decision counts","\u0001","\u0001","\u0001","\u0001",true],["Added routing cost per 1,000 tasks (calculation) (Only System One decisions (7 per task))",0,62.47,"usd","$0.00","$62.47","unclear","No interval or range was recorded for either side, so the gap ($0.00 vs $62.47) is not tested against run-to-run variation.","routing-overhead","router-overhead-cost-per-1000-tasks","\u0001","\u0001","Agent · in process · calculation per 1,000 tasks from recorded decision counts","thinking on · via Claude Code · calculation per 1,000 tasks from recorded decision counts","\u0001","\u0001","\u0001","\u0001",true],["Added routing delay per task (calculation) (Every model call routed (49.5 per task))",0.0000703,620.8785,"seconds","70.3 µs","620.9 s","unclear","No interval or range was recorded for either side, so the gap (70.3 µs vs 620.9 s, 8.8 million times) is not tested against run-to-run variation.","routing-overhead","router-overhead-delay-per-task","\u0001","\u0001","Agent · in process · calculation per task from recorded decision counts, decisions in line","thinking on · via Claude Code · calculation per task from recorded decision counts, decisions in line","\u0001","\u0001","\u0001","\u0001",true],["Added routing delay per task (calculation) (Only System One decisions (7 per task))",0.0000099,87.801,"seconds","9.9 µs","87.8 s","unclear","No interval or range was recorded for either side, so the gap (9.9 µs vs 87.8 s, 8.9 million times) is not tested against run-to-run variation.","routing-overhead","router-overhead-delay-per-task","\u0001","\u0001","Agent · in process · calculation per task from recorded decision counts, decisions in line","thinking on · via Claude Code · calculation per task from recorded decision counts, decisions in line","\u0001","\u0001","\u0001","\u0001",true]]}}}