{"i":16,"slug":"single-call-vs-agent-loop","chart":{"id":"agent-loop-by-task","title":"Strict passes per task: single call vs agent loop","subtitle":"Share of attempts per task that passed strictly; 2 or 3 attempts per task and configuration","kind":"grouped-bar","unit":"rate","polarity":"higher","yLabel":"Passed","series":{"$k":["name","points"],"$r":[["Claude Haiku 4.5 (single call) · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["Interval merge fix",1,0.4385,1,3],["DST day-length fix",0.3333,0.0615,0.7923,3],["CSV parser",0.6667,0.2077,0.9385,3],["Event-loop order",0,0,0.5615,3],["Room schedule",0,0,0.5615,3],["SemVer regex",1,0.4385,1,3],["Money refactor",0.6667,0.2077,0.9385,3],["SQL report",0,0,0.5615,3]]}],["Claude Haiku 4.5 (agent loop) · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["Interval merge fix",0.6667,0.2077,0.9385,3],["DST day-length fix",0.6667,0.2077,0.9385,3],["CSV parser",0.6667,0.2077,0.9385,3],["Event-loop order",1,0.4385,1,3],["Room schedule",0.6667,0.2077,0.9385,3],["SemVer regex",0.6667,0.2077,0.9385,3],["Money refactor",0,0,0.5615,3],["SQL report",0,0,0.5615,3]]}],["Claude Sonnet 5.5 (single call) · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["Interval merge fix",1,0.4385,1,3],["DST day-length fix",1,0.4385,1,3],["CSV parser",1,0.4385,1,3],["Event-loop order",1,0.4385,1,3],["Room schedule",1,0.4385,1,3],["SemVer regex",1,0.4385,1,3],["Money refactor",1,0.4385,1,3],["SQL report",1,0.4385,1,3]]}],["Claude Sonnet 5.5 (agent loop) · Claude Code",{"$k":["label","value","lo","hi","n"],"$r":[["Interval merge fix",1,0.3424,1,2],["DST day-length fix",1,0.3424,1,2],["CSV parser",1,0.3424,1,2],["Event-loop order",1,0.3424,1,2],["Room schedule",1,0.3424,1,2],["SemVer regex",1,0.3424,1,2],["Money refactor",1,0.3424,1,2],["SQL report",1,0.3424,1,2]]}],["GPT-6 Luna (single call) · Codex CLI",{"$k":["label","value","lo","hi","n"],"$r":[["Interval merge fix",1,0.3424,1,2],["DST day-length fix",1,0.3424,1,2],["CSV parser",1,0.3424,1,2],["Event-loop order",0,0,0.6576,2],["Room schedule",0.5,0.0945,0.9055,2],["SemVer regex",0.5,0.0945,0.9055,2],["Money refactor",0,0,0.6576,2],["SQL report",1,0.3424,1,2]]}],["GPT-6 Luna (agent loop) · Codex CLI",{"$k":["label","value","lo","hi","n"],"$r":[["Interval merge fix",1,0.3424,1,2],["CSV parser",0.5,0.0945,0.9055,2],["Event-loop order",1,0.3424,1,2],["Room schedule",1,0.3424,1,2],["SemVer regex",1,0.3424,1,2],["Money refactor",0.5,0.0945,0.9055,2],["SQL report",1,0.3424,1,2]]}]]},"note":"Whiskers are 95% Wilson intervals on 2 or 3 attempts, so they are very wide: read this chart for where a configuration failed, not for a ranking. Contaminated attempts (a read outside the work folder) are left out.","whisker":"ci95","sourceIds":["agent-agent-loop","agent-provider-h2h-hard"]}}