{"i":0,"slug":"swe-bench-verified","chart":{"id":"swebench-cost-vs-resolved","title":"Cost per instance vs resolved rate","subtitle":"Same 33 instances. Panel = API list price; Agent = notional subscription estimate","kind":"scatter","unit":"rate","xLabel":"Mean model cost per instance (USD)","yLabel":"Resolved rate","series":[{"name":"Public panel (mini-SWE-agent v2)","points":{"$k":["label","x","value","n"],"$r":[["Claude 4.5 Opus (high)",0.861,0.7273,33],["Gemini 3 Flash (high)",0.357,0.8182,33],["MiniMax M2.5 (high)",0.075,0.697,33],["Claude 4.6 Opus",0.61,0.697,33],["GLM 5 (high)",0.525,0.7879,33],["GPT 5.2 (high)",0.533,0.8485,33],["Claude 4.5 Sonnet (high)",0.692,0.7576,33],["Kimi K2.5 (high)",0.179,0.697,33],["DeepSeek V3.2 (high)",0.463,0.7273,33],["Claude 4.5 Haiku (high)",0.363,0.7576,33],["GPT 5 mini",0.051,0.6364,33]]}},{"name":"Agent","points":[{"label":"Agent","x":2.807,"value":0.7576,"n":33,"highlight":true}]}],"note":"Agent's cost includes repository onboarding, planning, verification and review; it is a list-price estimate for subscription calls, not an invoice. Panel costs are published API costs.","sourceIds":["agent-swebench-c1","agent-swebench-c2","swebench-leaderboard","price-anthropic"]}}