{"$k":["slug","chart"],"$r":[["routing-overhead",{"id":"router-overhead-decision-latency","title":"Time to make one routing decision","subtitle":"Median; whiskers = median to 95th percentile","kind":"dot-range","unit":"ms","yLabel":"Time per decision","whisker":"p50-p95","series":[{"name":"Decision time","points":{"$k":["label","value","lo","hi","n","highlight"],"$r":[["Deterministic routing policy (Agent, in process)",0.00142,0.00142,0.00233,20000,true],["Jev 1.13 (TypeSafe)",136.5,136.5,195.7,246,"\u0001"],["Claude Sonnet 5.5 (effort low, via Claude Code)",2597,2597,4298,82,"\u0001"],["Claude Haiku 4.5 (thinking on, via Claude Code)",12543,12543,34481,82,"\u0001"]]}}],"note":"The policy is the pure in-process decision (median 1.42 µs, p95 2.33 µs), timed over 20,000 decisions after 5,000 warm-up calls. The Claude routers are wall time per call through the Claude Code CLI, one call at a time, from the recorded routing runs. Jev is wall time of a direct HTTPS call from the same Mac over a home network (246 calls in a 35-second window; its API reports no server time), so the network is inside it. A different route from the CLI, so the chart shows what a caller waits, not model compute time. The whisker is the median to the 95th percentile, not a confidence interval.","sourceIds":["agent-routing-overhead","agent-routing","agent-jev-live"]}],["routing-overhead",{"id":"router-overhead-completed","title":"Routing calls that returned a decision","subtitle":"Completed calls ÷ calls; whiskers = 95% Wilson interval","kind":"dot-range","unit":"rate","yLabel":"Completed","whisker":"ci95","series":[{"name":"Completed","points":{"$k":["label","value","lo","hi","n","highlight"],"$r":[["Deterministic routing policy (Agent, in process)",1,0.9998,1,20000,true],["Jev 1.13 (TypeSafe)",1,0.9846,1,246,"\u0001"],["Claude Sonnet 5.5 (effort low, via Claude Code)",1,0.9552,1,82,"\u0001"],["Claude Haiku 4.5 (thinking on, via Claude Code)",1,0.9552,1,82,"\u0001"]]}}],"note":"A completed call returned a decision, right or wrong (accuracy is in the routing study). Whiskers are 95% Wilson intervals.","sourceIds":["agent-routing-overhead","agent-routing","agent-jev-live"]}],["routing-overhead",{"id":"router-overhead-cost-reported","title":"Cost per 1,000 routing decisions: no model call vs provider-reported","subtitle":"USD per 1,000 decisions","kind":"bar","unit":"usd","yLabel":"USD per 1,000 decisions","series":[{"name":"Cost per 1,000 decisions","points":[{"label":"Deterministic routing policy (Agent, in process)","value":0,"n":20000,"highlight":true},{"label":"Jev 1.13 (TypeSafe)","value":0.0337,"n":82,"highlight":false}]}],"note":"The policy makes no model call, so it costs nothing per decision. Jev’s figure is the cost its provider reported for the recorded production run (82 decisions). The input tokens of the live run give the same figure at the published price. The Claude routers are in the next chart: their cost is derived from list prices.","sourceIds":["agent-routing-overhead","agent-routing","price-jev"]}],["routing-overhead",{"id":"router-overhead-cost-per-1000-tasks","title":"Added routing cost per 1,000 tasks (calculation)","subtitle":"Decisions per task from recorded runs × cost per decision","kind":"grouped-bar","unit":"usd","yLabel":"USD per 1,000 tasks","series":[{"name":"Every model call routed (49.5 per task)","points":{"$k":["label","value"],"$r":[["Deterministic routing policy (Agent, in process)",0],["Jev 1.13 (TypeSafe)",1.67],["Claude Sonnet 5.5 (effort low, via Claude Code)",247.3],["Claude Haiku 4.5 (thinking on, via Claude Code)",441.74]]}},{"name":"Only System One decisions (7 per task)","points":{"$k":["label","value"],"$r":[["Deterministic routing policy (Agent, in process)",0],["Jev 1.13 (TypeSafe)",0.24],["Claude Sonnet 5.5 (effort low, via Claude Code)",34.97],["Claude Haiku 4.5 (thinking on, via Claude Code)",62.47]]}}],"note":"A calculation. Decisions per task: the median of 48 recorded bench runs (routing was off in them, so every model call counts as one decision a router would make). Median recorded work cost per task: $3.03. Claude router costs are list-price calculations; Jev’s is a list-price calculation too (its recorded run’s provider-reported cost is the same).","sourceIds":["agent-routing-overhead","calc-routing-overhead","agent-routing","price-anthropic","price-jev","agent-jev-live"]}],["routing-overhead",{"id":"router-overhead-delay-per-task","title":"Added routing delay per task (calculation)","subtitle":"Decisions per task × median decision time, if every decision waits in line","kind":"grouped-bar","unit":"seconds","yLabel":"Seconds per task","series":[{"name":"Every model call routed (49.5 per task)","points":{"$k":["label","value"],"$r":[["Deterministic routing policy (Agent, in process)",0.0000703],["Jev 1.13 (TypeSafe)",6.7568],["Claude Sonnet 5.5 (effort low, via Claude Code)",128.5515],["Claude Haiku 4.5 (thinking on, via Claude Code)",620.8785]]}},{"name":"Only System One decisions (7 per task)","points":{"$k":["label","value"],"$r":[["Deterministic routing policy (Agent, in process)",0.0000099],["Jev 1.13 (TypeSafe)",0.9555],["Claude Sonnet 5.5 (effort low, via Claude Code)",18.179],["Claude Haiku 4.5 (thinking on, via Claude Code)",87.801]]}}],"note":"A calculation and an upper bound: it assumes each decision waits for the one before. Median recorded task wall time: 10.3 min. Jev’s delay uses its live median over the API from one Mac (network included); the Claude routers’ includes the CLI.","sourceIds":["agent-routing-overhead","calc-routing-overhead","agent-routing","price-anthropic","price-jev","agent-jev-live"]}]]}