{"i":17,"slug":"haiku-thinking-on-off","chart":{"id":"haiku-thinking-router-exact","title":"Haiku thinking study: typed routing decisions answered exactly right","subtitle":"Claude Haiku 4.5 and Claude Sonnet 5.5 (low effort); 82 decisions, the same cases for every arm","kind":"dot-range","unit":"rate","polarity":"higher","yLabel":"Correct","series":[{"name":"Exact decisions (every scored question right)","points":{"$k":["label","value","lo","hi","n","highlight"],"$r":[["Claude Haiku 4.5 (thinking off) · Claude Code",0.8659,0.7755,0.9234,82,true],["Claude Haiku 4.5 (thinking on) · Claude Code",0.8902,0.8044,0.9412,82,false],["Claude Sonnet 5.5 (low) · Claude Code",0.939,0.8651,0.9737,82,false]]}},{"name":"Per-question accuracy","points":{"$k":["label","value","lo","hi","n","highlight"],"$r":[["Claude Haiku 4.5 (thinking off) · Claude Code",0.9124,0.8642,0.9446,194,true],["Claude Haiku 4.5 (thinking on) · Claude Code",0.9433,0.9013,0.968,194,false],["Claude Sonnet 5.5 (low) · Claude Code",0.9742,0.9411,0.9889,194,false]]}}],"note":"Whiskers are 95% Wilson intervals. Questions within a decision are related; per-question intervals are descriptive, not an independent-question test. The thinking-on and Sonnet arms are the recorded 2026-10-05 routing run, reused, not rerun; the thinking-off arm ran later on another account. An unanswered question counts as wrong.","whisker":"ci95","factContext":"typed routing decisions, thinking on vs off","sourceIds":["agent-haiku-thinking","agent-routing"]}}