{"i":13,"comparison":{"slug":"jev-1-13-vs-deterministic-routing-policy","a":"jev-1-13","b":"deterministic-routing-policy","title":"Jev 1.13 vs Deterministic routing policy","seoTitle":"Jev 1.13 vs Deterministic routing policy: benchmarks","description":"Jev 1.13 vs Deterministic routing policy: 3 measured metrics from one study (Time to make one routing decision; more), with sample sizes and intervals.","verdict":"Jev 1.13 and Deterministic routing policy share 3 measured metrics and 4 list-price calculations from one study. Deterministic routing policy leads on 1 row: Time to make one routing decision, 1.42 µs vs 137 ms. On those rows the p50–p95 bands do not overlap; only a 95% interval is a confidence interval. The other rows are 1 tie and 5 unclear; each row says why. Calculation rows are derived from list prices and recorded counts; they are not bills or runs.","rows":{"$k":["metric","aValue","bValue","unit","aDisplay","bDisplay","winner","basis","studySlug","chartId","aN","bN","aContext","bContext","rangeKind","spanKind","aRange","bRange","calculation"],"$r":[["Time to make one routing decision",136.5,0.00142,"ms","137 ms","1.42 µs","b","Jev 1.13’s median is above Deterministic routing policy’s 95th percentile (p50–p95 bands: Jev 1.13 137 ms to 196 ms; Deterministic routing policy 1.42 µs to 2.33 µs); not a confidence interval.","routing-overhead","router-overhead-decision-latency",246,20000,"routing overhead per decision · TypeSafe API","Agent · in process · routing overhead per decision","range","p50-p95",[136.5,195.7],[0.00142,0.00233],"\u0001"],["Routing calls that returned a decision",1,1,"rate","100% (246/246)","100% (20000/20000)","tie","The 95% intervals overlap (Jev 1.13 98% to 100%; Deterministic routing policy 100% to 100%), so this sample cannot separate them.","routing-overhead","router-overhead-completed",246,20000,"routing overhead per decision · TypeSafe API","Agent · in process · routing overhead per decision","ci95","ci95",[0.9846,1],[0.9998,1],"\u0001"],["Cost per 1,000 routing decisions: no model call vs provider-reported",0.0337,0,"usd","$0.034","$0.00","unclear","No interval or range was recorded for either side, so the gap ($0.034 vs $0.00) is not tested against run-to-run variation.","routing-overhead","router-overhead-cost-reported",82,20000,"routing overhead per decision · TypeSafe API","Agent · in process · routing overhead per decision","\u0001","\u0001","\u0001","\u0001","\u0001"],["Added routing cost per 1,000 tasks (calculation) (Every model call routed (49.5 per task))",1.67,0,"usd","$1.67","$0.00","unclear","No interval or range was recorded for either side, so the gap ($1.67 vs $0.00) is not tested against run-to-run variation.","routing-overhead","router-overhead-cost-per-1000-tasks","\u0001","\u0001","calculation per 1,000 tasks from recorded decision counts · TypeSafe API","Agent · in process · calculation per 1,000 tasks from recorded decision counts","\u0001","\u0001","\u0001","\u0001",true],["Added routing cost per 1,000 tasks (calculation) (Only System One decisions (7 per task))",0.24,0,"usd","$0.24","$0.00","unclear","No interval or range was recorded for either side, so the gap ($0.24 vs $0.00) is not tested against run-to-run variation.","routing-overhead","router-overhead-cost-per-1000-tasks","\u0001","\u0001","calculation per 1,000 tasks from recorded decision counts · TypeSafe API","Agent · in process · calculation per 1,000 tasks from recorded decision counts","\u0001","\u0001","\u0001","\u0001",true],["Added routing delay per task (calculation) (Every model call routed (49.5 per task))",6.7568,0.0000703,"seconds","6.76 s","70.3 µs","unclear","No interval or range was recorded for either side, so the gap (6.76 s vs 70.3 µs, 96,114x) is not tested against run-to-run variation.","routing-overhead","router-overhead-delay-per-task","\u0001","\u0001","calculation per task from recorded decision counts, decisions in line · TypeSafe API","Agent · in process · calculation per task from recorded decision counts, decisions in line","\u0001","\u0001","\u0001","\u0001",true],["Added routing delay per task (calculation) (Only System One decisions (7 per task))",0.9555,0.0000099,"seconds","0.96 s","9.9 µs","unclear","No interval or range was recorded for either side, so the gap (0.96 s vs 9.9 µs, 96,515x) is not tested against run-to-run variation.","routing-overhead","router-overhead-delay-per-task","\u0001","\u0001","calculation per task from recorded decision counts, decisions in line · TypeSafe API","Agent · in process · calculation per task from recorded decision counts, decisions in line","\u0001","\u0001","\u0001","\u0001",true]]}}}