{"i":133,"comparison":{"slug":"glm-5-vs-gpt-5-mini","a":"glm-5","b":"gpt-5-mini","title":"GLM 5 vs GPT 5 mini","seoTitle":"GLM 5 vs GPT 5 mini: measured benchmarks","description":"GLM 5 vs GPT 5 mini: 3 measured metrics from 2 studies (Resolved rate on the same 33 SWE-bench Verified instances; more), with sample sizes and intervals.","verdict":"GLM 5 and GPT 5 mini share 3 measured metrics from 2 studies. No row separates them: every interval or run range overlaps, too few runs were recorded, no interval was recorded, or more is not better for that metric. The rows are 1 tie and 2 unclear; each row says why.","rows":{"$k":["metric","aValue","bValue","unit","aDisplay","bDisplay","winner","basis","studySlug","n","chartId","aN","bN","aContext","bContext","rangeKind","spanKind","aRange","bRange"],"$r":[["Resolved rate on the same 33 SWE-bench Verified instances",0.7879,0.6364,"rate","79% (26/33)","64% (21/33)","tie","The 95% intervals overlap (GLM 5 62% to 89%; GPT 5 mini 47% to 78%), so this sample cannot separate them.","swe-bench-verified",33,"swebench-same-instance-leaderboard",33,33,"effort high · public mini-SWE-agent v2 run, same instances","public mini-SWE-agent v2 run, same instances","ci95","ci95",[0.6225,0.8932],[0.4662,0.7781]],["Model calls per instance",77.5,20.8,"calls","77.5","20.8","unclear","More or fewer calls is not better or worse by itself; this row describes behaviour, not a winner.","swe-bench-verified",33,"swebench-model-calls",33,33,"effort high · public mini-SWE-agent v2 run, same instances","public mini-SWE-agent v2 run, same instances","\u0001","\u0001","\u0001","\u0001"],["Recorded cost per resolved instance: Agent vs the public panel",0.667,0.08,"usd","$0.67","$0.080","unclear","No interval or range was recorded for either side, so the gap ($0.67 vs $0.080, 8.3x) is not tested against run-to-run variation.","cost-thought-experiments","\u0001","cost-per-resolved-agent-vs-panel",26,21,"effort high · public mini-SWE-agent v2 run, same instances","public mini-SWE-agent v2 run, same instances","\u0001","\u0001","\u0001","\u0001"]]}}}