GPT-5.6 Sol (max)
★ featuredTop 5 cheapest providers (Adjusted $/task)
Within the active global provider, residency and confidentiality filters.
| # | Provider | Platform | Raw input $/1M | Raw output $/1M | Adjusted $/task |
|---|---|---|---|---|---|
| 1 | OpenAI | OpenRouter | $2.00 | $10.00 | |
| 2 | Amazon Bedrock | OpenRouter | $4.40 | $22.00 | |
| 3 | Azure | OpenRouter | $5.00 | $30.00 | |
| 4 | AWS Bedrock | AWS Bedrock | $4.40 | $22.00 | |
| 5 | Azure AI Foundry | Azure AI Foundry | $5.00 | $30.00 |
Benchmarks
MODEL EVIDENCE
Benchmark sheet
24 / 73 registered benchmark versions covered · 26 observations including existing index snapshots.
Composite retains Coding Agent v1.4 · source 2026-09-09
The five Composite inputs remain unchanged. Its Coding Agent input is the median across complete harness results in the retained v1.4 snapshot from 2026-09-09. Artificial Analysis now publishes v1.5, with different components. Explore current v1.5 separately. Dated snapshot labels on other indices identify unversioned source captures, not a verified semantic version.
Profile signals
1 threshold-crossing signal flagged · 23 eligible benchmark families
How flags are calculated
Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.
- unusually strong CritPt (AA) snapshot-2026-09-10
Why
Observed: 0.32286 fractionPeer mean 0.03942 · peer sd 0.0762 · n 521 · families 367Directed z 3.719 · baseline z 1.436 · gap 2.284 · profile n 220.32286 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗Evidence
Axis: CritPt (AA) · snapshot-2026-09-10 · Published boardExact value:0.322857142857143fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recordedObservation id:aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:critpt
Protocol-compatible measured/vendor divergences
No verified protocol-compatible vendor/measured pair is available for this model; agreement cannot be assessed.
Agentic
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| AA-AnalystAgent Version snapshot-2026-09-10 | Published board Tests analyst tasks using agentic Python execution across fourteen domains. | 0.475 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: AA-AnalystAgent · snapshot-2026-09-10 · Published board Exact value: 0.475 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:analystAgent |
| AA-Briefcase Version snapshot-2026-09-10 | Published board Tests multi-week professional knowledge-work projects with linked tasks and large source collections. | 1475 Elomeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: AA-Briefcase · snapshot-2026-09-10 · Published board Exact value: 1475 EloObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:briefcaseBreakdown.overall.elo |
| GDPval-AA v2 Version 2 | Published board Tests professional knowledge-work deliverables across occupations using AA's Stirrup harness. | 1624.11 Elomeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: GDPval-AA v2 · 2 · Published board Exact value: 1624.11 EloObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:gdpval |
| Harvey LAB-AA Version snapshot-2026-09-10 | Published board Tests legal-work deliverables across practice areas on Harvey's private task set. | 0.87176 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: Harvey LAB-AA · snapshot-2026-09-10 · Published board Exact value: 0.871761470545665 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:harveyLab |
| ITBench-AA Version snapshot-2026-09-10 | Published board Tests root-cause diagnosis from offline Kubernetes incident snapshots. | 0.56215 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: ITBench-AA · snapshot-2026-09-10 · Published board Exact value: 0.562146892655367 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:itBenchSre |
| Terminal-Bench Hard (AA) Version 74221fb | Published board Tests a pinned 44-task hard subset of terminal-based work using Terminus 2. | 0.65909 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: Terminal-Bench Hard (AA) · 74221fb · Published board Exact value: 0.659090909090909 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:terminalbenchHard |
| Terminal-Bench v2.1 (AA) Version 2.1 | Published board Tests terminal-based work on the 89-task verified refresh using Terminus 2. | 0.88015 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: Terminal-Bench v2.1 (AA) · 2.1 · Published board Exact value: 0.880149812734082 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:terminalbenchV21 |
| Terminal-Bench v4.0 (AA) Version 4.0 | Published board Tests terminal-based work on the 66-task release using mini-SWE-agent v2.4.6. | 0.39899 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: Terminal-Bench v4.0 (AA) · 4.0 · Published board Exact value: 0.398989898989899 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:terminalbenchV40 |
Coding
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| Artificial Analysis Coding Agent Index v1.4 Version 1.4 | Codex The retained AA Coding Agent Index measures coding-agent systems using the earlier three-component implementation. | 0.65052 fractionmeasuredobserved 2026-09-09artificialanalysis.ai ↗ EvidenceAxis: Artificial Analysis Coding Agent Index v1.4 · 1.4 · Codex Exact value: 0.6505240024334411 fractionObserved: 2026-09-09 · publication date: not recorded Observation id: aa-coding:1.4:47Source: https://artificialanalysis.ai/ |
| Artificial Analysis Coding Agent Index v1.5 Version 1.5 | Codex Measures coding-agent systems on DeepSWE v1.1, Terminal-Bench 4.0 and SWE-Atlas-QnA. | 0.54559 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: Artificial Analysis Coding Agent Index v1.5 · 1.5 · Codex Exact value: 0.54559127289644 fractionObserved: 2026-09-10 · publication date: not recorded Observation id: aa-coding:1.5:709f801275dedae5675b1f56e97c9df3 |
| SciCode (AA subproblems) Version 1.0.1 | Published board Tests scientific Python programming with scientist-annotated background information. | 0.5706 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: SciCode (AA subproblems) · 1.0.1 · Published board Exact value: 0.570601851851852 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:scicode |
| AA Coding Index Version snapshot-2026-09-10 (unversioned) | Published board Published AA index from the retained API snapshot. No verified semantic version was supplied. | 77.4 pointsmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: AA Coding Index · snapshot-2026-09-10 (unversioned) · Published board Exact value: 77.4 pointsObserved: 2026-09-10 · publication date: not recorded Observation id: legacy:aa_coding_index:gpt-5.6-sol::maxProtocol: inspect · file data/raw/artificialanalysis.json |
Instruction-following
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| IFBench (AA single-turn) Version snapshot-2026-09-10 | Published board Tests precise single-turn instructions with deterministic rule checks. | 0.72653 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: IFBench (AA single-turn) · snapshot-2026-09-10 · Published board Exact value: 0.726530612244898 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:ifbench |
Knowledge
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| Humanity's Last Exam (AA text-only) Version snapshot-2026-09-10 | Published board Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset. | 0.4949 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: Humanity's Last Exam (AA text-only) · snapshot-2026-09-10 · Published board Exact value: 0.494902687673772 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:hle |
| AA-Omniscience Index Version snapshot-2026-09-10 | Published board Tests factual reliability while rewarding correct answers and penalizing hallucinations. | 21.96667 pointsmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: AA-Omniscience Index · snapshot-2026-09-10 · Published board Exact value: 21.9666666666667 pointsObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:omniscience |
Long-context
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| GDP.pdf (AA) Version snapshot-2026-09-10 | Published board Tests professional reasoning over long PDFs with AA document preparation and grading. | 0.272 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: GDP.pdf (AA) · snapshot-2026-09-10 · Published board Exact value: 0.272 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:gdpPdfAllPass |
| AA-LCR v1.1 Version 1.1 | Published board Tests reasoning across multiple long documents with corrected answer keys and grading. | 0.84 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: AA-LCR v1.1 · 1.1 · Published board Exact value: 0.84 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:lcr |
| MLCR-AA Version snapshot-2026-09-10 | Published board Tests medical-record synthesis and reasoning across long, fragmented case documents. | 0.26111 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: MLCR-AA · snapshot-2026-09-10 · Published board Exact value: 0.261111111111111 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:mlcrOverall |
Reasoning
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| AA Intelligence Index Version snapshot-2026-09-10 (unversioned) | Published board Published AA index from the retained API snapshot. No verified semantic version was supplied. | 47.1 pointsmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: AA Intelligence Index · snapshot-2026-09-10 (unversioned) · Published board Exact value: 47.1 pointsObserved: 2026-09-10 · publication date: not recorded Observation id: legacy:aa_intelligence_index:gpt-5.6-sol::maxProtocol: inspect · file data/raw/artificialanalysis.json |
Science
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| CritPt (AA) Version snapshot-2026-09-10 | Published board Tests research-level physics reasoning with Python, symbolic and numerical answers. | 0.32286 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: CritPt (AA) · snapshot-2026-09-10 · Published board Exact value: 0.322857142857143 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:critpt |
| GPQA Diamond (AA) Version snapshot-2026-09-10 | Published board Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset. | 0.94141 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: GPQA Diamond (AA) · snapshot-2026-09-10 · Published board Exact value: 0.941414141414141 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:gpqa |
Tool-use
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| AutomationBench-AA Version 1.0.6 | Published board Tests multi-app SaaS workflows through REST tools on a held-out AutomationBench split. | 0.60081 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: AutomationBench-AA · 1.0.6 · Published board Exact value: 0.6008114996276329 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:automationBenchPartialScore |
| EnterpriseOps-Gym-AA Version snapshot-2026-09-10 | Published board Tests enterprise workflows through MCP tools against resettable application environments. | 0.42913 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: EnterpriseOps-Gym-AA · snapshot-2026-09-10 · Published board Exact value: 0.42912563413906296 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:enterpriseOpsGym |
| τ²-Bench Telecom (AA) Version snapshot-2026-09-10 | Published board Tests dual-control telecom agents that coordinate tool use with a simulated user. | 0.85088 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: τ²-Bench Telecom (AA) · snapshot-2026-09-10 · Published board Exact value: 0.850877192982456 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:tau2 |
| τ³-Banking (AA) Version 1.0.1 | Published board Tests banking support agents that retrieve policies and change account state through tools. | 0.4433 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: τ³-Banking (AA) · 1.0.1 · Published board Exact value: 0.443298969072165 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:tauBanking |
Vision
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| MMMU Pro (AA) Version snapshot-2026-09-10 | Published board Tests multimodal understanding using challenging ten-option questions. | 0.8341 fractionmeasuredobserved 2026-09-10artificialanalysis.ai ↗ EvidenceAxis: MMMU Pro (AA) · snapshot-2026-09-10 · Published board Exact value: 0.834104046242775 fractionObserved: 2026-09-10T21:47:16.627Z · publication date: not recorded Observation id: aa:d93edfe8-bf35-49ad-b56e-b18116142a1c:mmmuPro |
Missing coverage · 51 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.
- AIME 2025 (AA) · 2025
Unknown: no published result matched to this configuration.
- APEX-Agents-AA · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- LiveCodeBench (AA historical field) · snapshot-2026-09-10
contested: Exact evaluation task window is unknown.
- Aider Polyglot · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- ARC-AGI-1 · 1
Unknown: no published result matched to this configuration.
- ARC-AGI-2 · 2
Unknown: no published result matched to this configuration.
- ARC-AGI-3 · 3
Unknown: no published result matched to this configuration.
- BuzzBench · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- CritPt · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- EQ-Bench 4 · 4
Unknown: no published result matched to this configuration.
- EQ-Bench Creative Writing v3 · 3
Unknown: no published result matched to this configuration.
- Judgemark v4 · 4
Unknown: no published result matched to this configuration.
- EQ-Bench Longform Creative Writing · v1.11
Unknown: no published result matched to this configuration.
- Slop Score · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- HELMET · snapshot-2026-09-10
manual required: Suite uses heterogeneous task/context metrics; no universal headline is published.
- Humanity's Last Exam (HLE) · snapshot-2026-09-10
manual required: README sample output is not attributable to a model and is not a current result.
- IFBench · snapshot-2026-09-10
manual required: Captured README specifies evaluation, not a named-model result.
- Japanese-RP-Bench (Aratako) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Japanese-RP-Bench v2 (tegnike fork) · 2
Unknown: no published result matched to this configuration.
- LiveBench · 2026-06-25
Unknown: no published result matched to this configuration.
- LongBench v2 · 2
Unknown: no published result matched to this configuration.
- LLM Creative Story-Writing Benchmark · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- LLM Divergent Thinking Creativity Benchmark · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Elimination Game Benchmark · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- MMMU · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- OTIS Mock AIME 2024-2025 · 2024-2025
contested: Captured July-2025 result predates the registered exact-match grading protocol; withheld.
- PingPong English (unadjusted mean) · 2
Unknown: no published result matched to this configuration.
- RP-Bench Community Elo · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- RULER · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SciCode · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SimpleBench · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- The Slop Index · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SlopBench · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Spiral-Bench · 1.2
Unknown: no published result matched to this configuration.
- SWE-bench Multilingual · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SWE-bench Multimodal · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SWE-Bench Pro Public · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SWE-bench Verified · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- τ²-bench · 2
Unknown: no published result matched to this configuration.
- τ³-Banking · 1.0.1
Unknown: no published result matched to this configuration.
- τ³-Voice · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Terminal-Bench · 4.0
Unknown: no published result matched to this configuration.
- Towards AI Editorial Writing · snapshot-2026-09-10
manual required: Private protocol and visually reported X values require xplainervideo capture and primary evidence review.
- UGI NatInt · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- UGI Willingness · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- UGI Writing · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- UGI · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Vending-Bench 2 · 2
Unknown: no published result matched to this configuration.
- WeirdML · 2
Unknown: no published result matched to this configuration.
- DesignArena Frontend · snapshot-2026-09-10 (unversioned)
Unknown: no published result matched to this configuration.
- DesignArena Full-Stack · snapshot-2026-09-10 (unversioned)
Unknown: no published result matched to this configuration.
Variants / reasoning settings
| Variant | Coding · snapshot 2026-09-10 | Intelligence · snapshot 2026-09-10 |
|---|---|---|
| GPT-5.6 Sol (xhigh) | 78.3 | 44.1 |
| GPT-5.6 Sol (max) | 77.4 | 47.1 |
| GPT-5.6 Sol (high) | 77.2 | 42.5 |
| GPT-5.6 Sol (medium) | 76.3 | 39.5 |
| GPT-5.6 Sol (low) | 69.7 | 33.8 |
| GPT-5.6 Sol (Non-reasoning) | 65.1 | 28.3 |
GitHub Copilot
Current usage-based billing · model token cost is converted to AI Credits at 1 credit = $0.01.
Token offers by platform — Adjusted $/task
Adjusted costs are modeled USD per task: AA output tokens × OpenRouter usage I/O (Chutes global fallback). These are general usage and benchmark proxies for coding-agent work. Missing AA data assumes 1,000 output tokens/task; unknown cache hit assumes 0%; unmeasured additional cache writes assume 0 tokens. Click any underlined price for exact inputs, dates and assumptions. Raw list prices use the selected fixed input/output blend, in USD per million tokens.
10 offers within the active global filters; “—” means the catalog is active but no public token price is available.
OpenRouter (6)
| OpenAI | globalopenai | $2.00 raw in $/1M | $10.00 raw out $/1M | |
| Amazon Bedrock | globalamazon-bedrock/us-east-1 | $4.40 raw in $/1M | $22.00 raw out $/1M | |
| OpenAI | globalopenai/fast | $4.00 raw in $/1M | $20.00 raw out $/1M | |
| Azure | globalazure | $5.00 raw in $/1M | $30.00 raw out $/1M | |
| Azure | globalazure/us | $5.50 raw in $/1M | $33.00 raw out $/1M | |
| Azure | euazure/euEU | $5.50 raw in $/1M | $33.00 raw out $/1M |
AWS Bedrock (1)
| AWS Bedrock | us-east-1 | $4.40 raw in $/1M | $22.00 raw out $/1M |
Azure AI Foundry (2)
| Azure AI Foundry | global | $5.00 raw in $/1M | $30.00 raw out $/1M | |
| Azure AI Foundry | euEU | $5.50 raw in $/1M | $33.00 raw out $/1M |
T-Systems LLM Hub (1)
| T-Systems LLM Hub | euEU | $5.23 raw in $/1M | $31.38 raw out $/1M |