{"i":14,"slug":"cli-model-latency-tokens","chart":{"id":"cli-vs-api-small-coding-latency","title":"CLI vs API: time for a small coding task","subtitle":"Matched cohort, small coding task, 3 runs per configuration","kind":"dot-range","unit":"seconds","yLabel":"Seconds","series":[{"name":"Total time","points":{"$k":["label","value","lo","hi","n"],"$r":[["OpenAI API · GPT-6 Luna · none",4.01,3.83,4.35,3],["OpenAI API · GPT-6.1 Sol · low",6,5.44,6.2,3],["Codex CLI · GPT-6 Luna · none",9.23,8.99,11.68,3],["OpenAI API · GPT-6.1 Sol · high",9.56,9.44,10.94,3],["Codex CLI · GPT-6.1 Sol · low",14.15,13.02,14.41,3],["Codex CLI · GPT-6.1 Sol · high",17.85,17.68,22.42,3]]}},{"name":"First useful output","points":{"$k":["label","value","lo","hi","n"],"$r":[["OpenAI API · GPT-6 Luna · none",0.67,0.62,0.81,3],["OpenAI API · GPT-6.1 Sol · low",1.05,0.97,1.4,3],["Codex CLI · GPT-6 Luna · none",8.68,8.27,11.01,3],["OpenAI API · GPT-6.1 Sol · high",5.31,4.99,6.42,3],["Codex CLI · GPT-6.1 Sol · low",13.6,12.52,13.83,3],["Codex CLI · GPT-6.1 Sol · high",17.27,17.13,21.86,3]]}}],"note":"Dot = median; whiskers = fastest and slowest run (a range, not a confidence interval). Every run in these cohorts passed its validator.","sourceIds":["agent-provider-explorer"]}}