{"i":14,"comparison":{"slug":"deterministic-routing-policy-vs-claude-sonnet-5-5","a":"deterministic-routing-policy","b":"claude-sonnet-5-5","title":"Deterministic routing policy vs Claude Sonnet 5.5","seoTitle":"Deterministic routing policy vs Claude Sonnet 5.5","description":"Deterministic routing policy vs Claude Sonnet 5.5: 2 measured metrics from one study (Time to make one routing decision; more), with sample sizes and intervals.","verdict":"Deterministic routing policy and Claude Sonnet 5.5 share 2 measured metrics and 4 list-price calculations from one study. Deterministic routing policy leads on 1 row: Time to make one routing decision, 1.42 µs vs 2,597 ms. On those rows the p50–p95 bands do not overlap; only a 95% interval is a confidence interval. The other rows are 1 tie and 4 unclear; each row says why. Calculation rows are derived from list prices and recorded counts; they are not bills or runs.","rows":{"$k":["metric","aValue","bValue","unit","aDisplay","bDisplay","winner","basis","studySlug","chartId","aN","bN","aContext","bContext","rangeKind","spanKind","aRange","bRange","calculation"],"$r":[["Time to make one routing decision",0.00142,2597,"ms","1.42 µs","2,597 ms","a","Claude Sonnet 5.5’s median is above Deterministic routing policy’s 95th percentile (p50–p95 bands: Deterministic routing policy 1.42 µs to 2.33 µs; Claude Sonnet 5.5 2,597 ms to 4,298 ms); not a confidence interval.","routing-overhead","router-overhead-decision-latency",20000,82,"Agent · in process · routing overhead per decision","effort low · via Claude Code · routing overhead per decision","range","p50-p95",[0.00142,0.00233],[2597,4298],"\u0001"],["Routing calls that returned a decision",1,1,"rate","100% (20000/20000)","100% (82/82)","tie","The 95% intervals overlap (Deterministic routing policy 100% to 100%; Claude Sonnet 5.5 96% to 100%), so this sample cannot separate them.","routing-overhead","router-overhead-completed",20000,82,"Agent · in process · routing overhead per decision","effort low · via Claude Code · routing overhead per decision","ci95","ci95",[0.9998,1],[0.9552,1],"\u0001"],["Added routing cost per 1,000 tasks (calculation) (Every model call routed (49.5 per task))",0,247.3,"usd","$0.00","$247.30","unclear","No interval or range was recorded for either side, so the gap ($0.00 vs $247.30) is not tested against run-to-run variation.","routing-overhead","router-overhead-cost-per-1000-tasks","\u0001","\u0001","Agent · in process · calculation per 1,000 tasks from recorded decision counts","effort low · via Claude Code · calculation per 1,000 tasks from recorded decision counts","\u0001","\u0001","\u0001","\u0001",true],["Added routing cost per 1,000 tasks (calculation) (Only System One decisions (7 per task))",0,34.97,"usd","$0.00","$34.97","unclear","No interval or range was recorded for either side, so the gap ($0.00 vs $34.97) is not tested against run-to-run variation.","routing-overhead","router-overhead-cost-per-1000-tasks","\u0001","\u0001","Agent · in process · calculation per 1,000 tasks from recorded decision counts","effort low · via Claude Code · calculation per 1,000 tasks from recorded decision counts","\u0001","\u0001","\u0001","\u0001",true],["Added routing delay per task (calculation) (Every model call routed (49.5 per task))",0.0000703,128.5515,"seconds","70.3 µs","128.6 s","unclear","No interval or range was recorded for either side, so the gap (70.3 µs vs 128.6 s, 1.8 million times) is not tested against run-to-run variation.","routing-overhead","router-overhead-delay-per-task","\u0001","\u0001","Agent · in process · calculation per task from recorded decision counts, decisions in line","effort low · via Claude Code · calculation per task from recorded decision counts, decisions in line","\u0001","\u0001","\u0001","\u0001",true],["Added routing delay per task (calculation) (Only System One decisions (7 per task))",0.0000099,18.179,"seconds","9.9 µs","18.2 s","unclear","No interval or range was recorded for either side, so the gap (9.9 µs vs 18.2 s, 1.8 million times) is not tested against run-to-run variation.","routing-overhead","router-overhead-delay-per-task","\u0001","\u0001","Agent · in process · calculation per task from recorded decision counts, decisions in line","effort low · via Claude Code · calculation per task from recorded decision counts, decisions in line","\u0001","\u0001","\u0001","\u0001",true]]}}}