Interactive comparison

AI Model Benchmarks & Real Cost per Solved Task

What AI models score, and what those runs actually cost — not just today's API list price.

Compare benchmark performance and cost

Benchmark

Human-filtered subset of SWE-bench; resolves real GitHub issues end-to-end. About this benchmark.

Showing 7 results evaluated under the SAME settings (mini-SWE-agent 2.0.0, reasoning effort: high) — the only results on this page that are directly comparable to each other.

Benchmark score and cost for SWE-bench Verified
					Current API price (in / out per 1M)	Evaluated	Source
Claude Opus 4.5, mini-SWE-agent 2.0.0, reasoning effort: high	76.8%	$0.75	$0.98	$0.01	$5.00 / $25	17 Feb 2026	SWE-bench (Princeton/Stanford team)
Gemini 3 Flash (Preview), mini-SWE-agent 2.0.0, reasoning effort: high	75.8%	$0.36	$0.47	$0.00	not published	17 Feb 2026	SWE-bench (Princeton/Stanford team)
MiniMax M2.5, mini-SWE-agent 2.0.0, reasoning effort: high	75.8%	$0.07	$0.10	$0.00	$0.300 / $1.20	17 Feb 2026	SWE-bench (Princeton/Stanford team)
GPT-5.2, mini-SWE-agent 2.0.0, reasoning effort: high	72.8%	$0.47	$0.65	$0.01	$1.75 / $14	17 Feb 2026	SWE-bench (Princeton/Stanford team)
Claude Sonnet 4.5, mini-SWE-agent 2.0.0, reasoning effort: high	71.4%	$0.66	$0.92	$0.01	$3.00 / $15	17 Feb 2026	SWE-bench (Princeton/Stanford team)
Gemini 3 Pro (Preview), mini-SWE-agent 2.0.0, reasoning effort: high	69.6%	$0.96	$1.38	$0.01	$2.00 / $12	26 Feb 2026	SWE-bench (Princeton/Stanford team)
Claude Haiku 4.5, mini-SWE-agent 2.0.0, reasoning effort: high	66.6%	$0.33	$0.50	$0.00	$1.00 / $5.00	17 Feb 2026	SWE-bench (Princeton/Stanford team)

Cost / point is a descriptive ratio within this benchmark and cost basis only — not the price of gaining another point, and never comparable across benchmarks or against a non-percent score.

25 catalogued models are not shown for this benchmark: 22 model not mapped to a tracked model id in our catalogue; 3 the source records no cost for this run. See the full catalogue.

Other reported results (different evaluation settings) — 15 results across 10 other configurations

Not proven equivalent to the group above — different agent, agent version, or reasoning effort. Each row names its own configuration.

Benchmark score and cost for SWE-bench Verified
					Current API price (in / out per 1M)	Evaluated	Source
Claude Opus 4.6, mini-SWE-agent 2.0.0, reasoning effort not stated by the source	75.6%	$0.55	$0.73	$0.01	$5.00 / $25	17 Feb 2026	SWE-bench (Princeton/Stanford team)
Claude Opus 4.5, mini-SWE-agent 1.16.0, reasoning effort: medium	74.4%	$0.72	$0.97	$0.01	$5.00 / $25	24 Nov 2025	SWE-bench (Princeton/Stanford team)
Gemini 3 Pro (Preview), mini-SWE-agent 1.15.0, reasoning effort not stated by the source	74.2%	$0.46	$0.62	$0.01	$2.00 / $12	18 Nov 2025	SWE-bench (Princeton/Stanford team)
GPT-5.2, mini-SWE-agent 1.17.2, reasoning effort: high	71.8%	$0.52	$0.72	$0.01	$1.75 / $14	11 Dec 2025	SWE-bench (Princeton/Stanford team)
Claude Sonnet 4.5, mini-SWE-agent 1.13.3, reasoning effort not stated by the source	70.6%	$0.56	$0.79	$0.01	$3.00 / $15	29 Sep 2025	SWE-bench (Princeton/Stanford team)
GPT-5.2, mini-SWE-agent 1.17.2, reasoning effort not stated by the source	69.0%	$0.27	$0.39	$0.00	$1.75 / $14	11 Dec 2025	SWE-bench (Princeton/Stanford team)
GPT-5.1, mini-SWE-agent 1.15.0, reasoning effort: medium	66.0%	$0.31	$0.46	$0.00	$1.25 / $10	20 Nov 2025	SWE-bench (Princeton/Stanford team)
GPT-5, mini-SWE-agent 1.7.0, reasoning effort: medium	65.0%	$0.28	$0.43	$0.00	$1.25 / $10	7 Aug 2025	SWE-bench (Princeton/Stanford team)
GPT-5 mini, mini-SWE-agent 1.7.0, reasoning effort: medium	59.8%	$0.04	$0.06	$0.00	$0.250 / $2.00	7 Aug 2025	SWE-bench (Princeton/Stanford team)
o3, mini-SWE-agent 1.0.0, reasoning effort not stated by the source	58.4%	$0.33	$0.57	$0.01	$2.00 / $8.00	26 Jul 2025	SWE-bench (Princeton/Stanford team)
GPT-5 mini, mini-SWE-agent 2.0.0, reasoning effort not stated by the source	56.2%	$0.05	$0.08	$0.00	$0.250 / $2.00	17 Feb 2026	SWE-bench (Princeton/Stanford team)
GLM-4.6, mini-SWE-agent 1.17.1, reasoning effort not stated by the source	55.4%	$0.10	$0.17	$0.00	$0.600 / $2.20	1 Dec 2025	SWE-bench (Princeton/Stanford team)
Gemini 2.5 Pro, mini-SWE-agent 1.0.0, reasoning effort not stated by the source	53.6%	$0.29	$0.54	$0.01	$1.25 / $10	26 Jul 2025	SWE-bench (Princeton/Stanford team)
GPT-5 nano, mini-SWE-agent 1.7.0, reasoning effort: medium	34.8%	$0.04	$0.11	$0.00	$0.050 / $0.400	7 Aug 2025	SWE-bench (Princeton/Stanford team)
Gemini 2.5 Flash, mini-SWE-agent 1.0.0, reasoning effort not stated by the source	28.7%	$0.13	$0.47	$0.00	$0.300 / $2.50	26 Jul 2025	SWE-bench (Princeton/Stanford team)

Cost / point is a descriptive ratio within this benchmark and cost basis only — not the price of gaining another point, and never comparable across benchmarks or against a non-percent score.

Whole-workload equivalence analysis (optional) Pick a model you used before to see whether anything newer is confirmed to match it on every material capability for your own workload — a stricter, narrower question than the benchmark comparison above.

I used

around Claude Opus 4.6 was released 5 Feb 2026. Newer Anthropic flagships by then: Claude Opus 4.7, Claude Opus 4.8, Claude Fable 5.

compare as of

No confirmed match today

$1,233 Claude Opus 4.6 — current cost for this workload

GPT-5.6 Sol has the most comparable evidence of any alternative, but is below baseline on coding, which is 55% of your workload.

Full baseline match

No model has enough comparable evidence to be called a baseline match for this workload. Closest candidates: Gemini 3 Flash (Preview) (55% covered), Kimi K3 (30% covered), Claude Fable 5.1 (30% covered).

Workload & assumptions Coding · 5K tasks/month · Standard

No confirmed match today$1,233 baseline/mo

Start with a preset

Each slider is a relative weight across your workload; the percentage shown is that weight's share of the total once every slider is combined. This is your workload mix — a separate number from a capability explanation like "55% of your workload" below, which names that capability's own internal weight WITHIN one category (e.g. how much of "coding" work is judged on the coding capability itself vs. tool use), not a second mix you set.

Software development & debugging 100% of your work

Research & document analysis 0% of your work

Content & marketing 0% of your work

Customer support & operations 0% of your work

Multi-step agents using tools 0% of your work

Task complexity

Tasks per month

5K tasks / month

Priorities (0 = ignore, 3 = most important)

These reorder the full "All models" list only — they never change which model is picked as best value, strongest, or cheapest meeting the baseline, and never change a capability verdict.

Cost ignore

Capability ignore

Speed ignore

Reliability ignore

Advanced assumptions

These per-task token counts, cache and retry assumptions are illustrative defaults, not measurements — editable here, applied only to your estimate.

Reasoning effort

Cache on Batch API on Include tool fees

Token basis

See why, for each role

Strongest supported option: GPT-5.6 Sol has the most comparable evidence of any alternative, but is below baseline on coding, which is 55% of your workload.
Cheapest meeting the baseline: No model has enough comparable evidence to be called a baseline match for this workload. Closest candidates: Gemini 3 Flash (Preview) (55% covered), Kimi K3 (30% covered), Claude Fable 5.1 (30% covered).
Best value: No model qualifies: Gemini 3 Flash (Preview) has comparable evidence for only 55% of your workload: there is no comparable result for tool use and autonomous execution and reasoning.

No model available today is confirmed to match Claude Opus 4.6 on your selected workload. GPT-5.6 Sol has the most comparable evidence of any alternative, but is below baseline on coding, which is 55% of your workload.

These are API model comparisons. An agent product (Claude Code, Codex, Gemini CLI, Cursor…) adds tools, memory, orchestration and an execution environment; a model benchmark does not establish what an agent application can do.

Claude Opus 4.6 — then (1 Jul 2026) $1,233

Claude Opus 4.6 — at today's price $1,233

Best value alternative today No alternative has enough comparable evidence yet.

Prices checked between 11 Sep 2026 and 30 Sep 2026 · dataset 2026-09-30.1 · Stale: Anthropic, OpenAI, Google, xAI, Moonshot AI (Kimi), Z.ai (GLM), Mistral AI, MiniMax

Research-based: we compare published prices and published benchmark results. We have not run these models ourselves, and there is no overall score.

Capability matrix

Model	Coding	Tool use	Autonomous execution	Reasoning
Claude Fable 5.1
Kimi K3
Gemini 3.5 Flash
GPT-6 Astra
Gemini 3.8 Flash
Claude Sonnet 4.6
Claude Opus 4.7
Claude Opus 4.8
Claude Fable 5
Grok 4
Grok 4 Fast
Grok 4.1 Fast
Grok 4.3
Grok 4.5
Grok 4.6
GPT-5.4
GPT-5.4 mini
GPT-5.4 nano
GPT-5.5
GPT-5.5 Pro
GPT-5.6 Luna
o3-pro
o3-mini
o3 deep research
DeepSeek-V4-Pro
Gemini 3.6 Flash
Gemini 3 Flash (Preview)
Gemini 2.5 Flash-Lite
Qwen3.8-Max
Kimi K2.6
Mistral Large 3
MiniMax M2.5
MiniMax M2.7
Claude Mythos 5
Claude Mythos 5.1
DeepSeek-V4.1-Flash
Grok 4.7
Claude Opus 5.5
Claude Sonnet 5.5
GPT-6.1 Sol
GPT-6 Sol
GPT-6 Luna
Claude Opus 5
GPT-5.6 Sol
GPT-5.6 Terra
Gemini 3.7 Flash
Gemini 3.1 Pro (Preview)
Claude Sonnet 4.5
Claude Sonnet 5
GPT-5
GPT-5 mini
GPT-5 nano
GPT-5.1
o3
Gemini 2.5 Pro
Gemini 2.5 Flash
GLM-4.6
GLM-5.3
Claude Haiku 4.5
GPT-5.2
Claude Opus 4.5

Timeline

Show the market as of 30 Sep 2026

Model	Released	Status	Input $/1M	Output $/1M
Claude Fable 5Anthropic	9 Jun 2026	Generally available	$10	$50
Claude Fable 5.1Anthropic	1 Sep 2026	Generally available	$10	$50
Claude Haiku 4.5Anthropic	15 Oct 2025	Generally available	$1.00	$5.00
Claude Mythos 5Anthropic	9 Jun 2026	Preview	$10	$50
Claude Mythos 5.1Anthropic	1 Sep 2026	Preview	$10	$50
Claude Opus 4.5Anthropic	24 Nov 2025	Generally available	$5.00	$25
Claude Opus 4.6Anthropic	5 Feb 2026	Generally available	$5.00	$25
Claude Opus 4.7Anthropic	16 Apr 2026	Generally available	$5.00	$25
Claude Opus 4.8Anthropic	28 May 2026	Generally available	$5.00	$25
Claude Opus 5Anthropic	24 Jul 2026	Generally available	$5.00	$25
Claude Opus 5.5Anthropic	22 Sep 2026	Generally available	$4.00	$20
Claude Sonnet 4.5Anthropic	29 Sep 2025	Deprecated Deprecated	$3.00	$15
Claude Sonnet 4.6Anthropic	17 Feb 2026	Generally available	$3.00	$15
Claude Sonnet 5Anthropic	30 Jun 2026	Generally available	$2.00	$10
Claude Sonnet 5.5Anthropic	28 Sep 2026	Generally available	$2.00	$10
DeepSeek-V4-ProDeepSeek	13 Aug 2026	Generally available	$1.32	$3.96
DeepSeek-V4.1-FlashDeepSeek	10 Sep 2026	Generally available	$0.300	$1.20
GLM-4.6Z.ai (GLM)	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	$0.600	$2.20
GLM-5.3Z.ai (GLM)	14 Aug 2026	Generally available	$1.40	$4.40
GPT-5OpenAI	7 Aug 2025	Deprecated Deprecated	$1.25	$10
GPT-5 miniOpenAI	7 Aug 2025	Deprecated Deprecated	$0.250	$2.00
GPT-5 nanoOpenAI	7 Aug 2025	Deprecated Deprecated	$0.050	$0.400
GPT-5.1OpenAI	13 Nov 2025	Deprecated Deprecated	$1.25	$10
GPT-5.2OpenAI	11 Dec 2025	Deprecated Deprecated	$1.75	$14
GPT-5.4OpenAI	5 Mar 2026	Generally available	$2.50	$15
GPT-5.4 miniOpenAI	17 Mar 2026	Generally available	$0.750	$4.50
GPT-5.4 nanoOpenAI	17 Mar 2026	Generally available	$0.200	$1.25
GPT-5.5OpenAI	24 Apr 2026	Generally available	$5.00	$30
GPT-5.5 ProOpenAI	24 Apr 2026	Generally available	$30	$180
GPT-5.6 LunaOpenAI	9 Jul 2026	Generally available	$0.200	$1.20
GPT-5.6 SolOpenAI	9 Jul 2026	Generally available	$4.00	$20
GPT-5.6 TerraOpenAI	9 Jul 2026	Generally available	$2.00	$12
GPT-6 AstraOpenAI	3 Sep 2026	Generally available	$10	$50
GPT-6 LunaOpenAI	22 Sep 2026	Generally available	$0.100	$0.500
GPT-6 SolOpenAI	22 Sep 2026	Generally available	$2.00	$10
GPT-6.1 SolOpenAI	29 Sep 2026	Generally available	$2.00	$10
Gemini 2.5 FlashGoogle	17 Jun 2025	Generally available	$0.300	$2.50
Gemini 2.5 Flash-LiteGoogle	22 Jul 2025	Generally available	$0.100	$0.400
Gemini 2.5 ProGoogle	17 Jun 2025	Generally available	$1.25	$10
Gemini 3 Flash (Preview)Google	17 Dec 2025	Preview	—	—
Gemini 3.1 Pro (Preview)Google	19 Feb 2026	Preview	$2.00	$12
Gemini 3.5 FlashGoogle	19 May 2026	Generally available	$1.50	$9.00
Gemini 3.6 FlashGoogle	21 Jul 2026	Generally available	$0.750	$3.75
Gemini 3.7 FlashGoogle	13 Aug 2026	Generally available	$0.750	$3.75
Gemini 3.8 FlashGoogle	2 Sep 2026	Generally available	$0.750	$3.75
Grok 4xAI	9 Jul 2025	Generally available	—	—
Grok 4 FastxAI	19 Sep 2025	Generally available	$0.200	$0.500
Grok 4.1 FastxAI	19 Nov 2025	Generally available	$0.200	$0.500
Grok 4.3xAI	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	$1.25	$2.50
Grok 4.5xAI	16 Jul 2026	Generally available	$2.00	$6.00
Grok 4.6xAI	12 Aug 2026	Generally available	$2.00	$6.00
Grok 4.7xAI	18 Sep 2026	Generally available	$2.00	$6.00
Kimi K2.6Moonshot AI (Kimi)	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	$0.950	$4.00
Kimi K3Moonshot AI (Kimi)	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	$3.00	$15
MiniMax M2.5MiniMax	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Deprecated Deprecated	$0.300	$1.20
MiniMax M2.7MiniMax	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	$0.300	$1.20
Mistral Large 3Mistral AI	1 Dec 2025	Generally available	$0.500	$1.50
Qwen3.8-MaxAlibaba (Qwen)	3 Aug 2026	Generally available	—	—
o3OpenAI	16 Apr 2025	Deprecated Deprecated	$2.00	$8.00
o3 deep researchOpenAI	26 Jun 2025	Deprecated Deprecated	—	—
o3-miniOpenAI	31 Jan 2025	Deprecated Deprecated	$1.10	$4.40
o3-proOpenAI	10 Jun 2025	Deprecated Deprecated	$20	$80

Capability vs. estimated workload cost

Benchmark

Estimated monthly cost (log scale) vs. selected benchmark

Table alternative to the scatter chart above
Model	Est. cost / mo	Benchmark score

Catch-up by provider

Capability

Anthropic first met the baseline with Claude Opus 5 on 24 Jul 2026 — Above baseline.
OpenAI first met the baseline with GPT-5.5 on 24 Apr 2026 — Similar range.
Google first met the baseline with Gemini 3.1 Pro (Preview) on 19 Feb 2026 — Similar range. First cheaper than the baseline while meeting it: Gemini 3.1 Pro (Preview), 19 Feb 2026.
xAI not yet shown on comparable evidence.
DeepSeek not yet shown on comparable evidence.
Alibaba (Qwen) not yet shown on comparable evidence.
Moonshot AI (Kimi) not yet shown on comparable evidence.
Z.ai (GLM) not yet shown on comparable evidence.
Mistral AI not yet shown on comparable evidence.
MiniMax not yet shown on comparable evidence.
Meta not yet shown on comparable evidence.

No provider has yet matched the whole workload on comparable evidence.

Every option, ranked

Sorted by capability match against your baseline (the default ranking) — set a priority below to reorder it.

Status

		Meets baseline		Released	Status	Savings	Speed	More details
Claude Fable 5.1Anthropic	$2,395	Cannot confirm	30%	1 Sep 2026	Generally available	-94%	67 tok/s	Release · status · savings · speed Released 1 Sep 2026 Status Generally available Savings -94% Speed 67 tok/s
Kimi K3Moonshot AI (Kimi)	$723	Cannot confirm	30%	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	41%	39 tok/s	Release · status · savings · speed Released — (Release date not published; listed from 11 Sep 2026, when its price was first read.) Status Generally available Savings 41% Speed 39 tok/s
Gemini 3.5 FlashGoogle	$411	Cannot confirm	20%	19 May 2026	Generally available	67%	no data	Release · status · savings · speed Released 19 May 2026 Status Generally available Savings 67% Speed no data
GPT-6 AstraOpenAI	$2,466	Cannot confirm	10%	3 Sep 2026	Generally available	-100%	54 tok/s	Release · status · savings · speed Released 3 Sep 2026 Status Generally available Savings -100% Speed 54 tok/s
Gemini 3.8 FlashGoogle	$181	Cannot confirm	10%	2 Sep 2026	Generally available	85%	261 tok/s	Release · status · savings · speed Released 2 Sep 2026 Status Generally available Savings 85% Speed 261 tok/s
Claude Sonnet 4.6Anthropic	$740	Cannot confirm	0%	17 Feb 2026	Generally available	40%	no data	Release · status · savings · speed Released 17 Feb 2026 Status Generally available Savings 40% Speed no data
Claude Opus 4.7Anthropic	$1,233	Cannot confirm	0%	16 Apr 2026	Generally available	0%	no data	Release · status · savings · speed Released 16 Apr 2026 Status Generally available Savings 0% Speed no data
Claude Opus 4.8Anthropic	$1,233	Cannot confirm	0%	28 May 2026	Generally available	0%	no data	Release · status · savings · speed Released 28 May 2026 Status Generally available Savings 0% Speed no data
Claude Fable 5Anthropic	$2,466	Cannot confirm	10%	9 Jun 2026	Generally available	-100%	no data	Release · status · savings · speed Released 9 Jun 2026 Status Generally available Savings -100% Speed no data
Grok 4xAI	—no price row covers this date	Cannot confirm	0%	9 Jul 2025	Generally available	—	no data	Release · status · savings · speed Released 9 Jul 2025 Status Generally available Savings — Speed no data
Grok 4 FastxAI	$35	Cannot confirm	0%	19 Sep 2025	Generally available	97%	no data	Release · status · savings · speed Released 19 Sep 2025 Status Generally available Savings 97% Speed no data
Grok 4.1 FastxAI	$35	Cannot confirm	0%	19 Nov 2025	Generally available	97%	no data	Release · status · savings · speed Released 19 Nov 2025 Status Generally available Savings 97% Speed no data
Grok 4.3xAI	$185	Cannot confirm	0%	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	85%	no data	Release · status · savings · speed Released — (Release date not published; listed from 11 Sep 2026, when its price was first read.) Status Generally available Savings 85% Speed no data
Grok 4.5xAI	$360	Cannot confirm	0%	16 Jul 2026	Generally available	71%	55 tok/s	Release · status · savings · speed Released 16 Jul 2026 Status Generally available Savings 71% Speed 55 tok/s
Grok 4.6xAI	$380	Cannot confirm	10%	12 Aug 2026	Generally available	69%	55 tok/s	Release · status · savings · speed Released 12 Aug 2026 Status Generally available Savings 69% Speed 55 tok/s
GPT-5.4OpenAI	$685	Cannot confirm	0%	5 Mar 2026	Generally available	44%	no data	Release · status · savings · speed Released 5 Mar 2026 Status Generally available Savings 44% Speed no data
GPT-5.4 miniOpenAI	$205	Cannot confirm	0%	17 Mar 2026	Generally available	83%	no data	Release · status · savings · speed Released 17 Mar 2026 Status Generally available Savings 83% Speed no data
GPT-5.4 nanoOpenAI	$56	Cannot confirm	0%	17 Mar 2026	Generally available	95%	no data	Release · status · savings · speed Released 17 Mar 2026 Status Generally available Savings 95% Speed no data
GPT-5.5OpenAI	$1,370	Cannot confirm	20%	24 Apr 2026	Generally available	-11%	85 tok/s	Release · status · savings · speed Released 24 Apr 2026 Status Generally available Savings -11% Speed 85 tok/s
GPT-5.5 ProOpenAI	$10,890	Cannot confirm	0%	24 Apr 2026	Generally available	-783%	no data	Release · status · savings · speed Released 24 Apr 2026 Status Generally available Savings -783% Speed no data
GPT-5.6 LunaOpenAI	$56	Cannot confirm	0%	9 Jul 2026	Generally available	95%	112 tok/s	Release · status · savings · speed Released 9 Jul 2026 Status Generally available Savings 95% Speed 112 tok/s
o3-proOpenAI	$5,940	Cannot confirm	0%	10 Jun 2025	Deprecated	-382%	no data	Release · status · savings · speed Released 10 Jun 2025 Status Deprecated Savings -382% Speed no data
o3-miniOpenAI	$272	Cannot confirm	0%	31 Jan 2025	Deprecated	78%	no data	Release · status · savings · speed Released 31 Jan 2025 Status Deprecated Savings 78% Speed no data
o3 deep researchOpenAI	—no price row covers this date	Cannot confirm	0%	26 Jun 2025	Deprecated	—	no data	Release · status · savings · speed Released 26 Jun 2025 Status Deprecated Savings — Speed no data
DeepSeek-V4-ProDeepSeek	$222	Cannot confirm	10%	13 Aug 2026	Generally available	82%	72 tok/s	Release · status · savings · speed Released 13 Aug 2026 Status Generally available Savings 82% Speed 72 tok/s
Gemini 3.6 FlashGoogle	$181	Cannot confirm	0%	21 Jul 2026	Generally available	85%	195 tok/s	Release · status · savings · speed Released 21 Jul 2026 Status Generally available Savings 85% Speed 195 tok/s
Gemini 3 Flash (Preview)Google	—no price row covers this date	Cannot confirm	55%	17 Dec 2025	Preview	—	no data	Release · status · savings · speed Released 17 Dec 2025 Status Preview Savings — Speed no data
Gemini 2.5 Flash-LiteGoogle	$21	Cannot confirm	0%	22 Jul 2025	Generally available	98%	no data	Release · status · savings · speed Released 22 Jul 2025 Status Generally available Savings 98% Speed no data
Qwen3.8-MaxAlibaba (Qwen)	—no price row covers this date	Cannot confirm	0%	3 Aug 2026	Generally available	—	no data	Release · status · savings · speed Released 3 Aug 2026 Status Generally available Savings — Speed no data
Kimi K2.6Moonshot AI (Kimi)	$211	Cannot confirm	0%	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	83%	no data	Release · status · savings · speed Released — (Release date not published; listed from 11 Sep 2026, when its price was first read.) Status Generally available Savings 83% Speed no data
Mistral Large 3Mistral AI	$132	Cannot confirm	0%	1 Dec 2025	Generally available	89%	no data	Release · status · savings · speed Released 1 Dec 2025 Status Generally available Savings 89% Speed no data
MiniMax M2.5MiniMax	$62	Cannot confirm	55%	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Deprecated	95%	no data	Release · status · savings · speed Released — (Release date not published; listed from 11 Sep 2026, when its price was first read.) Status Deprecated Savings 95% Speed no data
MiniMax M2.7MiniMax	$67	Cannot confirm	0%	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	95%	no data	Release · status · savings · speed Released — (Release date not published; listed from 11 Sep 2026, when its price was first read.) Status Generally available Savings 95% Speed no data
Claude Mythos 5Anthropic	$2,466	Cannot confirm	0%	9 Jun 2026	Preview	-100%	no data	Release · status · savings · speed Released 9 Jun 2026 Status Preview Savings -100% Speed no data
Claude Mythos 5.1Anthropic	$2,395	Cannot confirm	0%	1 Sep 2026	Preview	-94%	no data	Release · status · savings · speed Released 1 Sep 2026 Status Preview Savings -94% Speed no data
DeepSeek-V4.1-FlashDeepSeek	$60	Cannot confirm	0%	10 Sep 2026	Generally available	95%	199 tok/s	Release · status · savings · speed Released 10 Sep 2026 Status Generally available Savings 95% Speed 199 tok/s
Grok 4.7xAI	$380	Cannot confirm	0%	18 Sep 2026	Generally available	69%	no data	Release · status · savings · speed Released 18 Sep 2026 Status Generally available Savings 69% Speed no data
Claude Opus 5.5Anthropic	$968	Cannot confirm	0%	22 Sep 2026	Generally available	22%	no data	Release · status · savings · speed Released 22 Sep 2026 Status Generally available Savings 22% Speed no data
Claude Sonnet 5.5Anthropic	$493	Cannot confirm	0%	28 Sep 2026	Generally available	60%	no data	Release · status · savings · speed Released 28 Sep 2026 Status Generally available Savings 60% Speed no data
GPT-6.1 SolOpenAI	$484	Cannot confirm	0%	29 Sep 2026	Generally available	61%	no data	Release · status · savings · speed Released 29 Sep 2026 Status Generally available Savings 61% Speed no data
GPT-6 SolOpenAI	$493	Cannot confirm	0%	22 Sep 2026	Generally available	60%	no data	Release · status · savings · speed Released 22 Sep 2026 Status Generally available Savings 60% Speed no data
GPT-6 LunaOpenAI	$24	Cannot confirm	0%	22 Sep 2026	Generally available	98%	no data	Release · status · savings · speed Released 22 Sep 2026 Status Generally available Savings 98% Speed no data
Claude Opus 5Anthropic	$1,233	No	85%	24 Jul 2026	Generally available	0%	51 tok/s	Release · status · savings · speed Released 24 Jul 2026 Status Generally available Savings 0% Speed 51 tok/s
GPT-5.6 SolOpenAI	$986	No	85%	9 Jul 2026	Generally available	20%	60 tok/s	Release · status · savings · speed Released 9 Jul 2026 Status Generally available Savings 20% Speed 60 tok/s
GPT-5.6 TerraOpenAI	$559	No	65%	9 Jul 2026	Generally available	55%	87 tok/s	Release · status · savings · speed Released 9 Jul 2026 Status Generally available Savings 55% Speed 87 tok/s
Gemini 3.7 FlashGoogle	$181	No	65%	13 Aug 2026	Generally available	85%	295 tok/s	Release · status · savings · speed Released 13 Aug 2026 Status Generally available Savings 85% Speed 295 tok/s
Gemini 3.1 Pro (Preview)Google	$548	No	85%	19 Feb 2026	Preview	56%	108 tok/s	Release · status · savings · speed Released 19 Feb 2026 Status Preview Savings 56% Speed 108 tok/s
Claude Sonnet 4.5Anthropic	$740	No	55%	29 Sep 2025	Deprecated	40%	no data	Release · status · savings · speed Released 29 Sep 2025 Status Deprecated Savings 40% Speed no data
Claude Sonnet 5Anthropic	$493	No	65%	30 Jun 2026	Generally available	60%	74 tok/s	Release · status · savings · speed Released 30 Jun 2026 Status Generally available Savings 60% Speed 74 tok/s
GPT-5OpenAI	$425	No	55%	7 Aug 2025	Deprecated	66%	no data	Release · status · savings · speed Released 7 Aug 2025 Status Deprecated Savings 66% Speed no data
GPT-5 miniOpenAI	$85	No	55%	7 Aug 2025	Deprecated	93%	no data	Release · status · savings · speed Released 7 Aug 2025 Status Deprecated Savings 93% Speed no data
GPT-5 nanoOpenAI	$17	No	55%	7 Aug 2025	Deprecated	99%	no data	Release · status · savings · speed Released 7 Aug 2025 Status Deprecated Savings 99% Speed no data
GPT-5.1OpenAI	$425	No	55%	13 Nov 2025	Deprecated	66%	no data	Release · status · savings · speed Released 13 Nov 2025 Status Deprecated Savings 66% Speed no data
o3OpenAI	$446	No	55%	16 Apr 2025	Deprecated	64%	no data	Release · status · savings · speed Released 16 Apr 2025 Status Deprecated Savings 64% Speed no data
Gemini 2.5 ProGoogle	$425	No	55%	17 Jun 2025	Generally available	66%	no data	Release · status · savings · speed Released 17 Jun 2025 Status Generally available Savings 66% Speed no data
Gemini 2.5 FlashGoogle	$105	No	55%	17 Jun 2025	Generally available	91%	no data	Release · status · savings · speed Released 17 Jun 2025 Status Generally available Savings 91% Speed no data
GLM-4.6Z.ai (GLM)	$123	No	55%	—Release date not published; listed from 11 Sep 2026, when its price was first read.	Generally available	90%	37 tok/s	Release · status · savings · speed Released — (Release date not published; listed from 11 Sep 2026, when its price was first read.) Status Generally available Savings 90% Speed 37 tok/s
GLM-5.3Z.ai (GLM)	$263	No	65%	14 Aug 2026	Generally available	79%	62 tok/s	Release · status · savings · speed Released 14 Aug 2026 Status Generally available Savings 79% Speed 62 tok/s
Claude Haiku 4.5Anthropic	$247	No	65%	15 Oct 2025	Generally available	80%	78 tok/s	Release · status · savings · speed Released 15 Oct 2025 Status Generally available Savings 80% Speed 78 tok/s
GPT-5.2OpenAI	$595	No	75%	11 Dec 2025	Deprecated	52%	70 tok/s	Release · status · savings · speed Released 11 Dec 2025 Status Deprecated Savings 52% Speed 70 tok/s
Claude Opus 4.5Anthropic	$1,233	No	85%	24 Nov 2025	Generally available	0%	46 tok/s	Release · status · savings · speed Released 24 Nov 2025 Status Generally available Savings 0% Speed 46 tok/s

How we compare & sources

Method

Every price comes from the vendor's own published pages (pricing pages, docs, launch posts), each with the date we read it. Every capability verdict compares published benchmark results for the same test between a candidate and your baseline model — never a single overall score. Results are graded by how comparable the evidence is (same independent evaluator, same publisher, or separate write-ups), and a capability with no comparable result is always labelled insufficient evidence rather than guessed at.

Price freshness by provider

Anthropic: prices checked 31 days ago Stale
OpenAI: prices checked 31 days ago Stale
Google: prices checked 31 days ago Stale
xAI: prices checked 31 days ago Stale
DeepSeek: prices checked 30 days ago
Moonshot AI (Kimi): prices checked 31 days ago Stale
Z.ai (GLM): prices checked 31 days ago Stale
Mistral AI: prices checked 31 days ago Stale
MiniMax: prices checked 31 days ago Stale

Excluded from this comparison

Meta Llama (hosted API): Meta wound down its first-party Llama API on 2026-07-06, so no vendor-published price exists. Third-party hosts publish prices for running the weights, which is the price of a host rather than the price of a model.
Qwen3.8-Max (price): The model is listed, but its price is withheld: the official Alibaba Cloud row is labelled "Qwen-Max" and could not be tied to this exact model version.
DeepSeek price history before 2026-09-10: Only prices published on DeepSeek's own documentation (api-docs.deepseek.com) are recorded, so there is no DeepSeek price history before 2026-09-10.
Off-peak and time-of-day rates: DeepSeek charges half price outside 01:00-04:00 and 06:00-10:00 UTC on weekdays. Estimates use the peak rate, which is the conservative assumption; a workload that runs mostly off-peak costs less than shown.
SWE-Bench Pro cost data: The public Scale AI leaderboard (labs.scale.com/leaderboard/swe_bench_pro_public, checked 2026-09-12) shows the resolve rate with a confidence interval only. It notes that some runs used a capped cost limit and a 50-turn limit while others were uncapped with a 250-turn limit, and that some rows used the mini-swe-agent harness, but it does not publish a per-run dollar cost or a consistent agent version. Without those we do not estimate a cost per task or group results by agent setup. Scores are shown as published.
GPQA Diamond cost data: None of the GPQA Diamond results we hold (reported by Anthropic, OpenAI, Epoch AI and Vals AI) include a per-run cost, and GPQA is typically run as a direct model query rather than an agent task, so there is no agent setup to group results by. Scores are shown as published.

Some historical prices and specs could not be confirmed from an official source. Those fields are left blank rather than estimated.

Sources (180)

Pricing — Anthropic, retrieved 11 Sep 2026
Models overview — Anthropic, retrieved 11 Sep 2026
Model deprecations — Anthropic, retrieved 11 Sep 2026
Claude Platform release notes — Anthropic, retrieved 11 Sep 2026
Introducing Claude Sonnet 5 — Anthropic, retrieved 11 Sep 2026
Claude Opus 4.6 — Anthropic, retrieved 11 Sep 2026
System Card: Claude Opus 4.6 — Anthropic, retrieved 11 Sep 2026
Claude Opus 4.5 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Haiku 4.5 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Sonnet 4.5 — Anthropic, retrieved 11 Sep 2026
Claude Opus 4.1 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Opus 5 — Anthropic, retrieved 11 Sep 2026
Introducing Sonnet 4.6 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Opus 4.7 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Opus 4.8 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Fable 5 and Claude Mythos 5 — Anthropic, retrieved 11 Sep 2026
Grok Models & Pricing — xAI (SpaceXAI), retrieved 11 Sep 2026
Grok 4.5 — xAI (SpaceXAI), retrieved 11 Sep 2026
Grok 4.6 — xAI (SpaceXAI), retrieved 11 Sep 2026
Introducing Grok 4.5 — xAI (SpaceXAI), retrieved 11 Sep 2026
Grok 4.6 — xAI (SpaceXAI), retrieved 11 Sep 2026
Grok 4 — xAI (SpaceXAI), retrieved 11 Sep 2026
Grok 4 Fast — xAI (SpaceXAI), retrieved 11 Sep 2026
Grok 4.1 Fast and Agent Tools API — xAI (SpaceXAI), retrieved 11 Sep 2026
Release Notes — xAI (SpaceXAI), retrieved 11 Sep 2026
API Pricing — xAI (SpaceXAI), retrieved 11 Sep 2026
Claude Platform release notes — Anthropic, retrieved 11 Sep 2026
Pricing | OpenAI API — OpenAI, retrieved 11 Sep 2026
Changelog | OpenAI API — OpenAI, retrieved 11 Sep 2026
Deprecations | OpenAI API — OpenAI, retrieved 11 Sep 2026
gpt-5.6-sol | OpenAI API Models — OpenAI, retrieved 11 Sep 2026
gpt-5.6-terra | OpenAI API Models — OpenAI, retrieved 11 Sep 2026
gpt-5.6-luna | OpenAI API Models — OpenAI, retrieved 11 Sep 2026
Introducing GPT-5.6 series: Sol, Terra and Luna — OpenAI Developer Community (secondary, quoting OpenAI's official launch post), retrieved 11 Sep 2026
OpenAI cuts GPT-5.6 Luna and Terra prices — EdTech Innovation Hub (secondary news, citing OpenAI), retrieved 11 Sep 2026
Models & Pricing | DeepSeek API Docs — DeepSeek, retrieved 11 Sep 2026
Change Log | DeepSeek API Docs — DeepSeek, retrieved 11 Sep 2026
DeepSeek V4 Preview Release — DeepSeek, retrieved 11 Sep 2026
DeepSeek-V4-Pro GA Release — DeepSeek, retrieved 11 Sep 2026
DeepSeek V4.1 Flash Release — DeepSeek, retrieved 11 Sep 2026
DeepSeek V3.1 Release — DeepSeek, retrieved 11 Sep 2026
deepseek-ai/DeepSeek-V4-Pro — DeepSeek (Hugging Face model card), retrieved 11 Sep 2026
deepseek-ai/DeepSeek-V4-Flash — DeepSeek (Hugging Face model card), retrieved 11 Sep 2026
GPT-5.6: Frontier intelligence that scales with your ambition — OpenAI, retrieved 11 Sep 2026
Advancing the price-performance frontier with GPT-5.6 — OpenAI, retrieved 11 Sep 2026
OpenAI API pricing (snapshot read 2026-08-07) — OpenAI, retrieved 7 Aug 2026
Gemini Developer API pricing — Google, retrieved 11 Sep 2026
What's new in Gemini 3.8 Flash — Google, retrieved 11 Sep 2026
Gemini models — Google, retrieved 11 Sep 2026
Release notes | Gemini API — Google, retrieved 11 Sep 2026
Gemini API deprecations — Google, retrieved 11 Sep 2026
Introducing Gemini 3.8 Flash and 3.8 Flash Cyber — Google (blog.google), retrieved 11 Sep 2026
Gemini 3.8 Flash - Model Card — Google DeepMind, retrieved 11 Sep 2026
Kimi API chat pricing — Moonshot AI, retrieved 11 Sep 2026
Z.ai pricing — Zhipu / Z.ai, retrieved 11 Sep 2026
Mistral AI Pricing — Mistral AI, retrieved 11 Sep 2026
Mistral AI API Pricing — Mistral AI, retrieved 11 Sep 2026
MiniMax Pay as You Go pricing — MiniMax, retrieved 11 Sep 2026
Alibaba Cloud Model Studio model pricing — Alibaba Cloud, retrieved 11 Sep 2026
Upcoming changes to Llama API — Meta, retrieved 11 Sep 2026
zai-org/GLM-4.6 — Hugging Face / Zhipu, retrieved 11 Sep 2026
moonshotai/Kimi-K2-Instruct LICENSE — Hugging Face / Moonshot AI, retrieved 11 Sep 2026
Mistral Large 3 collection — Hugging Face / Mistral AI, retrieved 11 Sep 2026
MiniMaxAI/MiniMax-M2 — Hugging Face / MiniMax, retrieved 11 Sep 2026
Qwen/Qwen3-32B LICENSE — Hugging Face / Alibaba Qwen, retrieved 11 Sep 2026
Introducing Gemini 3.8 Flash and 3.8 Flash Cyber — Google, retrieved 11 Sep 2026
API Pricing — OpenAI, retrieved 11 Sep 2026
gpt-6-astra model page — OpenAI, retrieved 11 Sep 2026
GPT-6 Astra: A new generation of intelligence — OpenAI, retrieved 11 Sep 2026
Introducing GPT-5.5 — OpenAI, retrieved 11 Sep 2026
Introducing GPT-5.4 mini and nano — OpenAI, retrieved 11 Sep 2026
Introducing Claude Opus 5 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Sonnet 5 — Anthropic, retrieved 11 Sep 2026
Claude Fable 5 and Claude Mythos 5 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Opus 4.8 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Fable 5.1 and Claude Mythos 5.1 — Anthropic, retrieved 11 Sep 2026
Introducing Claude Opus 4.7 — Anthropic, retrieved 11 Sep 2026
Models overview — Anthropic, retrieved 11 Sep 2026
Claude Opus 4.7 model page — Anthropic, retrieved 11 Sep 2026
Claude Opus 4.8 model page — Anthropic, retrieved 11 Sep 2026
Pricing — Anthropic, retrieved 11 Sep 2026
Models & Pricing — DeepSeek, retrieved 11 Sep 2026
Change Log — DeepSeek, retrieved 11 Sep 2026
DeepSeek-V4.1-Flash — DeepSeek (Hugging Face org), retrieved 11 Sep 2026
GLM-5.3: Frontier Coding with Emergent Cyber Capabilities — Z.ai, retrieved 11 Sep 2026
GLM-5.3 Overview — Z.ai, retrieved 11 Sep 2026
Z.ai API Pricing — Z.ai, retrieved 11 Sep 2026
Kimi K3 Quickstart — Moonshot AI, retrieved 11 Sep 2026
Kimi Model Pricing — Moonshot AI, retrieved 11 Sep 2026
Kimi-K3 — Moonshot AI (Hugging Face org), retrieved 11 Sep 2026
MoonshotAI/Kimi-K3 — Moonshot AI, retrieved 11 Sep 2026
zai-org/GLM-5.3 — Z.ai (Hugging Face org), retrieved 11 Sep 2026
Release Notes | SpaceXAI Docs — xAI (SpaceXAI), retrieved 11 Sep 2026
Introducing Grok 4.6 — xAI (SpaceXAI), retrieved 11 Sep 2026
Pricing | Mistral — Mistral AI, retrieved 11 Sep 2026
Pricing | Mistral (API) — Mistral AI, retrieved 11 Sep 2026
Gemini 3.8 Flash - Model Card — Google DeepMind, retrieved 11 Sep 2026
Gemini 3.7 Flash - Model Card — Google DeepMind, retrieved 11 Sep 2026
Gemini 3.6 Flash - Model Card — Google DeepMind, retrieved 11 Sep 2026
OpenAI API changelog — OpenAI, retrieved 11 Sep 2026
Comparison of AI Models across Intelligence, Performance, and Price — Artificial Analysis, retrieved 11 Sep 2026
Claude Opus 4.6 (Non-reasoning, high) - Intelligence, Performance & Price Analysis — Artificial Analysis, retrieved 11 Sep 2026
Gemini 3.8 Flash (high) - Intelligence, Performance & Price Analysis — Artificial Analysis, retrieved 11 Sep 2026
Claude Sonnet 5 (max) - Intelligence, Performance & Price Analysis — Artificial Analysis, retrieved 11 Sep 2026
Claude 4.5 Haiku (Non-reasoning) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
GPT-5.5 (xhigh) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
GPT-5.2 (xhigh) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
GPT-5.6 Sol (max) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
GPT-5.6 Terra (max) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Gemini 3.6 Flash (high) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Gemini 3 Pro Preview (high) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Gemini 3.1 Pro Preview - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Grok 4.5 (high) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Claude Opus 4.5 (Non-reasoning) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
DeepSeek V4 Flash 0731 (max) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Qwen3 Max - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Kimi K2 - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
GLM-4.6 (Non-reasoning) - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
MiniMax-M2 - Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
SWE-bench Leaderboards — SWE-bench (Princeton/Stanford team), retrieved 11 Sep 2026
Terminal-Bench Leaderboard — Terminal-Bench (Stanford / Harbor / Laude Institute), retrieved 11 Sep 2026
ARC Prize Leaderboard — ARC Prize Foundation, retrieved 11 Sep 2026
Text Arena Leaderboard (arena.ai, formerly LMArena) — LMArena / Arena.ai, retrieved 11 Sep 2026
Task-Completion Time Horizons of Frontier AI Models — METR, retrieved 11 Sep 2026
Claude Opus 4.6 (Non-reasoning, high) - Intelligence, Performance & Price Analysis | Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Claude Opus 4.6 (max) - Intelligence, Performance & Price Analysis | Artificial Analysis — Artificial Analysis, retrieved 11 Sep 2026
Claude Sonnet 5 (Adaptive Reasoning, Max Effort) vs Claude Opus 4.6 (Adaptive Reasoning, Max Effort): Model Comparison — Artificial Analysis, retrieved 11 Sep 2026
Model Comparison Tool (Sonnet 5, Opus 4.6, Gemini 3.8 Flash, Grok 4.6, DeepSeek V4 Pro 0813) — Artificial Analysis, retrieved 11 Sep 2026
Model Comparison Tool (Opus 4.6, GPT-5.6 Terra/Luna/Sol, GPT-6 Astra) — Artificial Analysis, retrieved 11 Sep 2026
Model Comparison Tool (Opus 4.6, Opus 5, Fable 5.1, Gemini 3.6/3.7 Flash) — Artificial Analysis, retrieved 11 Sep 2026
Model Comparison Tool (Opus 4.6, Kimi K3, GLM-5.3, DeepSeek V4 Flash, Gemini 3.1 Pro Preview) — Artificial Analysis, retrieved 11 Sep 2026
Model Comparison Tool (Opus 4.6, Opus 4.5 non-reasoning, GPT-5.2 xhigh) — Artificial Analysis, retrieved 11 Sep 2026
LLM Leaderboard - Best Text & Chat AI Models Compared (Text Arena, Overall) — Arena Intelligence (LMArena), retrieved 11 Sep 2026
LLM Leaderboard - Best Text & Chat AI Models Compared (Text Arena, Coding category) — Arena Intelligence (LMArena), retrieved 11 Sep 2026
GPQA Diamond | Vals AI — Vals AI, retrieved 11 Sep 2026
MMLU Pro | Vals AI — Vals AI, retrieved 11 Sep 2026
GPQA Diamond | Epoch AI — Epoch AI, retrieved 11 Sep 2026
SWE-bench Verified | Epoch AI — Epoch AI, retrieved 11 Sep 2026
FrontierMath Tiers 1-3 (v2) | Epoch AI — Epoch AI, retrieved 11 Sep 2026
Scale Labs Leaderboard: SWE-Bench Pro (Private Dataset) — Scale AI (SEAL), retrieved 11 Sep 2026
SWE-Bench Pro Leaderboard AI Coding Benchmark (Public Dataset) | Scale — Scale AI (SEAL), retrieved 11 Sep 2026
Scale Labs Leaderboard: MCP Atlas — Scale AI (SEAL), retrieved 11 Sep 2026
Scale Labs Leaderboard: Humanity's Last Exam — Scale AI (SEAL), retrieved 11 Sep 2026
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments (OSWorld-Verified) — OSWorld / xlang.ai, retrieved 11 Sep 2026
OSWorld 2.0: Benchmarking computer-use agents on long-horizon real-world tasks — OSWorld / xlang.ai, retrieved 11 Sep 2026
Context Arena — MRCR v2 (8-needle) needle-summary API — Context Arena, retrieved 11 Sep 2026
Models & Pricing | DeepSeek API Docs — DeepSeek, retrieved 12 Sep 2026
Gemini Developer API pricing — Google, retrieved 12 Sep 2026
Gemini Developer API pricing (read 2026-08-07) — Google, retrieved 7 Aug 2026
Gemini deprecations — Google, retrieved 12 Sep 2026
Model deprecations - Claude Platform Docs — Anthropic, retrieved 12 Sep 2026
Gemini deprecations (release date column) — Google, retrieved 12 Sep 2026
OpenAI API changelog — OpenAI, retrieved 12 Sep 2026
OpenAI API changelog — OpenAI, retrieved 30 Sep 2026
OpenAI API changelog — OpenAI, retrieved 30 Sep 2026
gpt-6-astra model page — OpenAI, retrieved 30 Sep 2026
Introducing GPT-5.6 — OpenAI, retrieved 30 Sep 2026
Introducing GPT-6.1 Sol — OpenAI, retrieved 30 Sep 2026
gpt-6.1-sol model page — OpenAI, retrieved 30 Sep 2026
API Pricing — OpenAI, retrieved 30 Sep 2026
API Pricing — OpenAI, retrieved 30 Sep 2026
Claude Sonnet 5.5 overview — Anthropic, retrieved 30 Sep 2026
Claude Sonnet 5.5 — Anthropic, retrieved 30 Sep 2026
Pricing — Anthropic, retrieved 30 Sep 2026
Pricing — Anthropic, retrieved 30 Sep 2026
Gemini Developer API pricing — Google, retrieved 30 Sep 2026
xAI models and pricing — xAI, retrieved 30 Sep 2026
Models and pricing — DeepSeek, retrieved 30 Sep 2026
xAI API Pricing & Models (Grok 4.7) — xAI, retrieved 22 Sep 2026
— , retrieved 22 Sep 2026
Claude Opus 5.5 Launch & Pricing — Anthropic, retrieved 22 Sep 2026
OpenAI API changelog — OpenAI, retrieved 30 Sep 2026
Introducing GPT-6 Sol and Luna — OpenAI, retrieved 30 Sep 2026
gpt-6-sol model page — OpenAI, retrieved 30 Sep 2026
OpenAI models — OpenAI, retrieved 30 Sep 2026
API Pricing — OpenAI, retrieved 30 Sep 2026
Model deprecations — Anthropic, retrieved 30 Sep 2026
xAI models and pricing — xAI, retrieved 30 Sep 2026
Models and pricing — DeepSeek, retrieved 30 Sep 2026
SWE-bench Leaderboards — SWE-bench (Princeton/Stanford team), retrieved 12 Sep 2026

Dataset version 2026-09-30.1, verified through 30 Sep 2026.

How to read this

The three pick cards at the top answer three different questions: the strongest option with enough comparable evidence, the cheapest option confirmed to meet your baseline, and the best value overall. A verdict of "insufficient evidence" is not a bad result: it means no comparable benchmark result exists yet, and the page says so rather than guessing.