{"i":100,"comparison":{"slug":"claude-opus-4-5-vs-deepseek-v3-2","a":"claude-opus-4-5","b":"deepseek-v3-2","title":"Claude Opus 4.5 vs DeepSeek V3.2","seoTitle":"Claude Opus 4.5 vs DeepSeek V3.2: measured benchmarks","description":"Claude Opus 4.5 vs DeepSeek V3.2: 3 measured metrics from 2 studies, with sample sizes, intervals and every failure counted.","verdict":"Claude Opus 4.5 and DeepSeek V3.2 share 3 measured metrics from 2 studies. No row separates them: every interval or run range overlaps, too few runs were recorded, no interval was recorded, or more is not better for that metric. The rows are 1 tie and 2 unclear; each row says why.","rows":{"$k":["metric","aValue","bValue","unit","aDisplay","bDisplay","winner","basis","studySlug","n","chartId","aN","bN","aContext","bContext","rangeKind","spanKind","aRange","bRange"],"$r":[["Resolved rate on the same 33 SWE-bench Verified instances",0.7273,0.7273,"rate","73% (24/33)","73% (24/33)","tie","The 95% intervals overlap (Claude Opus 4.5 56% to 85%; DeepSeek V3.2 56% to 85%), so this sample cannot separate them.","swe-bench-verified",33,"swebench-same-instance-leaderboard",33,33,"effort high · public mini-SWE-agent v2 run, same instances","effort high · public mini-SWE-agent v2 run, same instances","ci95","ci95",[0.5578,0.8493],[0.5578,0.8493]],["Model calls per instance",35.9,88.2,"calls","35.9","88.2","unclear","More or fewer calls is not better or worse by itself; this row describes behaviour, not a winner.","swe-bench-verified",33,"swebench-model-calls",33,33,"effort high · public mini-SWE-agent v2 run, same instances","effort high · public mini-SWE-agent v2 run, same instances","\u0001","\u0001","\u0001","\u0001"],["Recorded cost per resolved instance: Agent vs the public panel",1.184,0.637,"usd","$1.18","$0.64","unclear","No interval or range was recorded for either side, so the gap ($1.18 vs $0.64) is not tested against run-to-run variation.","cost-thought-experiments",24,"cost-per-resolved-agent-vs-panel",24,24,"effort high · public mini-SWE-agent v2 run, same instances","effort high · public mini-SWE-agent v2 run, same instances","\u0001","\u0001","\u0001","\u0001"]]}}}