{"i":25,"slug":"harder-tasks-head-to-head","chart":{"id":"harder-h2h-pass-by-task","title":"Strict pass rate by task","subtitle":"One bar per configuration and task; each bar rests on only a few calls, so the 95% intervals are wide","kind":"grouped-bar","unit":"rate","polarity":"higher","yLabel":"Strict pass rate","whisker":"ci95","series":{"$k":["name","points"],"$r":[["GPT-6.1 Sol (medium) · Codex CLI",{"$k":["label","value","lo","hi","n"],"$r":[["10x10 nonogram",0.75,0.3006,0.9544,4],["Sudoku, 22 givens",0.25,0.0456,0.6994,4],["6x6 Skyscrapers",1,0.5101,1,4],["Seeded shuffle output",0.75,0.3006,0.9544,4]]}],["Claude Opus 5.5 · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["10x10 nonogram",1,0.4385,1,3],["Sudoku, 22 givens",0,0,0.5615,3],["6x6 Skyscrapers",0.3333,0.0615,0.7923,3],["Seeded shuffle output",0.3333,0.0615,0.7923,3]]}],["Claude Sonnet 5.5 · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["10x10 nonogram",1,0.5101,1,4],["Sudoku, 22 givens",0,0,0.4899,4],["6x6 Skyscrapers",0,0,0.4899,4],["Seeded shuffle output",0.5,0.15,0.85,4]]}],["Claude Haiku 4.5 · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["10x10 nonogram",0,0,0.5615,3],["Sudoku, 22 givens",0,0,0.5615,3],["6x6 Skyscrapers",0,0,0.5615,3],["Seeded shuffle output",0,0,0.5615,3]]}]]},"note":"Each bar is 3 to 4 calls, so one call moves a bar by a quarter or a third. Whiskers are 95% Wilson intervals; with this few calls they overlap almost everywhere.","sourceIds":["agent-harder-tasks"]}}