Sonnet 4.6 (medium)
★ featuredTop 5 cheapest providers (Adjusted $/task)
Within the active global provider, residency and confidentiality filters.
| # | Provider | Platform | Raw input $/1M | Raw output $/1M | Adjusted $/task |
|---|---|---|---|---|---|
| 1 | Google Vertex AI | Google Vertex AI | $3.00 | $15.00 | |
| 2 | Anthropic | Anthropic | $3.00 | $15.00 | |
| 3 | Claude Platform on AWS | OpenRouter | $3.00 | $15.00 | |
| 4 | Azure | OpenRouter | $3.00 | $15.00 | |
| 5 | Anthropic | OpenRouter | $3.00 | $15.00 |
Benchmarks
ⓘ Intelligence.ai (formerly DesignArena) publishes this result at product/family scope without an effort setting. It is attached exactly once to claude-sonnet-4.6::medium, the deterministic family representative used by collapsed comparisons; this does not assert that Intelligence.ai tested this specific effort setting.
MODEL EVIDENCE
Benchmark sheet
1 / 73 registered benchmark versions covered · 3 observations including existing index snapshots.
Composite retains Coding Agent v1.4 · source 2026-09-09
The five Composite inputs remain unchanged. Its Coding Agent input is the median across complete harness results in the retained v1.4 snapshot from 2026-09-09. Artificial Analysis now publishes v1.5, with different components. Explore current v1.5 separately. Dated snapshot labels on other indices identify unversioned source captures, not a verified semantic version.
Profile signals
Insufficient evidence to evaluate · 2 eligible benchmark families
How flags are calculated
Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.
Protocol-compatible measured/vendor divergences
No verified protocol-compatible vendor/measured pair is available for this model; agreement cannot be assessed.
Coding
| Benchmark / version | Evaluation group | Score / provenance |
|---|---|---|
| Artificial Analysis Coding Agent Index v1.4 Version 1.4 | Claude Code The retained AA Coding Agent Index measures coding-agent systems using the earlier three-component implementation. | 0.38649 fractionmeasuredobserved 2026-09-09artificialanalysis.ai ↗ EvidenceAxis: Artificial Analysis Coding Agent Index v1.4 · 1.4 · Claude Code Exact value: 0.3864931360777617 fractionObserved: 2026-09-09 · publication date: not recorded Observation id: aa-coding:1.4:2Source: https://artificialanalysis.ai/ |
| DesignArena Frontend Version snapshot-2026-09-10 (unversioned) | Published board Published Elo. Exact source attachment is retained; fewer than 200 battles excludes a row from radar normalization and anomaly peers. | 1211 Elomeasured2824 battlesobserved 2026-09-10designarena.ai ↗ EvidenceAxis: DesignArena Frontend · snapshot-2026-09-10 (unversioned) · Published board Exact value: 1211 EloObserved: 2026-09-10 · publication date: not recorded Observation id: legacy:frontend:claude-sonnet-4.6::mediumSource: https://www.designarena.ai/ Protocol: inspect · file data/raw/designarena.json |
| DesignArena Full-Stack Version snapshot-2026-09-10 (unversioned) | Published board Published Elo. Exact source attachment is retained; fewer than 200 battles excludes a row from radar normalization and anomaly peers. | 1223 Elomeasured2030 battlesobserved 2026-09-10designarena.ai ↗ EvidenceAxis: DesignArena Full-Stack · snapshot-2026-09-10 (unversioned) · Published board Exact value: 1223 EloObserved: 2026-09-10 · publication date: not recorded Observation id: legacy:fullstack:claude-sonnet-4.6::mediumSource: https://www.designarena.ai/ Protocol: inspect · file data/raw/designarena.json |
Missing coverage · 74 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.
- AIME 2025 (AA) · 2025
Unknown: no published result matched to this configuration.
- AA-AnalystAgent · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- APEX-Agents-AA · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- AutomationBench-AA · 1.0.6
Unknown: no published result matched to this configuration.
- AA-Briefcase · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Artificial Analysis Coding Agent Index v1.5 · 1.5
Unknown: no published result matched to this configuration.
- CritPt (AA) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- EnterpriseOps-Gym-AA · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- GDP.pdf (AA) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- GDPval-AA v2 · 2
Unknown: no published result matched to this configuration.
- GPQA Diamond (AA) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Harvey LAB-AA · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Humanity's Last Exam (AA text-only) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- IFBench (AA single-turn) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- ITBench-AA · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- AA-LCR v1.1 · 1.1
Unknown: no published result matched to this configuration.
- LiveCodeBench (AA historical field) · snapshot-2026-09-10
contested: Historical task date window is unverified; all values withheld.
- MLCR-AA · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- MMMU Pro (AA) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- AA-Omniscience Index · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SciCode (AA subproblems) · 1.0.1
Unknown: no published result matched to this configuration.
- τ²-Bench Telecom (AA) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- τ³-Banking (AA) · 1.0.1
Unknown: no published result matched to this configuration.
- Terminal-Bench Hard (AA) · 74221fb
Unknown: no published result matched to this configuration.
- Terminal-Bench v2.1 (AA) · 2.1
Unknown: no published result matched to this configuration.
- Terminal-Bench v4.0 (AA) · 4.0
Unknown: no published result matched to this configuration.
- Aider Polyglot · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- ARC-AGI-1 · 1
Unknown: no published result matched to this configuration.
- ARC-AGI-2 · 2
Unknown: no published result matched to this configuration.
- ARC-AGI-3 · 3
Unknown: no published result matched to this configuration.
- BuzzBench · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- CritPt · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- EQ-Bench 4 · 4
Unknown: no published result matched to this configuration.
- EQ-Bench Creative Writing v3 · 3
Unknown: no published result matched to this configuration.
- Judgemark v4 · 4
Unknown: no published result matched to this configuration.
- EQ-Bench Longform Creative Writing · v1.11
Unknown: no published result matched to this configuration.
- Slop Score · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- HELMET · snapshot-2026-09-10
manual required: Suite uses heterogeneous task/context metrics; no universal headline is published.
- Humanity's Last Exam (HLE) · snapshot-2026-09-10
manual required: README sample output is not attributable to a model and is not a current result.
- IFBench · snapshot-2026-09-10
manual required: Captured README specifies evaluation, not a named-model result.
- Japanese-RP-Bench (Aratako) · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Japanese-RP-Bench v2 (tegnike fork) · 2
Unknown: no published result matched to this configuration.
- LiveBench · 2026-06-25
Unknown: no published result matched to this configuration.
- LongBench v2 · 2
Unknown: no published result matched to this configuration.
- LLM Creative Story-Writing Benchmark · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- LLM Divergent Thinking Creativity Benchmark · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Elimination Game Benchmark · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- MMMU · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- OTIS Mock AIME 2024-2025 · 2024-2025
contested: Captured July-2025 result predates the registered exact-match grading protocol; withheld.
- PingPong English (unadjusted mean) · 2
Unknown: no published result matched to this configuration.
- RP-Bench Community Elo · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- RULER · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SciCode · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SimpleBench · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- The Slop Index · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SlopBench · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Spiral-Bench · 1.2
Unknown: no published result matched to this configuration.
- SWE-bench Multilingual · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SWE-bench Multimodal · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SWE-Bench Pro Public · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- SWE-bench Verified · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- τ²-bench · 2
Unknown: no published result matched to this configuration.
- τ³-Banking · 1.0.1
Unknown: no published result matched to this configuration.
- τ³-Voice · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Terminal-Bench · 4.0
Unknown: no published result matched to this configuration.
- Towards AI Editorial Writing · snapshot-2026-09-10
manual required: Private protocol and visually reported X values require xplainervideo capture and primary evidence review.
- UGI NatInt · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- UGI Willingness · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- UGI Writing · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- UGI · snapshot-2026-09-10
Unknown: no published result matched to this configuration.
- Vending-Bench 2 · 2
Unknown: no published result matched to this configuration.
- WeirdML · 2
Unknown: no published result matched to this configuration.
- AA Coding Index · snapshot-2026-09-10 (unversioned)
Unknown: no published result matched to this configuration.
- AA Intelligence Index · snapshot-2026-09-10 (unversioned)
Unknown: no published result matched to this configuration.
Variants / reasoning settings
| Variant | Coding · snapshot 2026-09-10 | Intelligence · snapshot 2026-09-10 |
|---|---|---|
| Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) | 63.0 | 30.5 |
| Claude Sonnet 4.6 (Non-reasoning, Low Effort) | — | 23.3 |
| Claude Sonnet 4.6 (Non-reasoning, High Effort) | — | 24.7 |
| Sonnet 4.6 (medium) | — | — |
GitHub Copilot
Current usage-based billing · model token cost is converted to AI Credits at 1 credit = $0.01.
Legacy annual Pro/Pro+ request billing only.
GitHub marks this multiplier as subject to change.
Token offers by platform — Adjusted $/task
Adjusted costs are modeled USD per task: AA output tokens × OpenRouter usage I/O (Chutes global fallback). These are general usage and benchmark proxies for coding-agent work. Missing AA data assumes 1,000 output tokens/task; unknown cache hit assumes 0%; unmeasured additional cache writes assume 0 tokens. Click any underlined price for exact inputs, dates and assumptions. Raw list prices use the selected fixed input/output blend, in USD per million tokens.
14 offers within the active global filters; “—” means the catalog is active but no public token price is available.
Google Vertex AI (2)
| Google Vertex AI | global | $3.00 raw in $/1M | $15.00 raw out $/1M | |
| Google Vertex AI | europe-west1EU | $3.30 raw in $/1M | $16.50 raw out $/1M |
Anthropic (1)
| Anthropic | global | $3.00 raw in $/1M | $15.00 raw out $/1M |
OpenRouter (9)
| Claude Platform on AWS | globalclaude-on-aws | $3.00 raw in $/1M | $15.00 raw out $/1M | |
| Azure | globalazure/global | $3.00 raw in $/1M | $15.00 raw out $/1M | |
| Anthropic | globalanthropic | $3.00 raw in $/1M | $15.00 raw out $/1M | |
| Amazon Bedrock | globalamazon-bedrock/global | $3.00 raw in $/1M | $15.00 raw out $/1M | |
| globalgoogle-vertex/global | $3.00 raw in $/1M | $15.00 raw out $/1M | ||
| Amazon Bedrock | globalamazon-bedrock/us | $3.30 raw in $/1M | $16.50 raw out $/1M | |
| Amazon Bedrock | euamazon-bedrock/eu-west-1EU | $3.30 raw in $/1M | $16.50 raw out $/1M | |
| eugoogle-vertex/europeEU | $3.30 raw in $/1M | $16.50 raw out $/1M | ||
| globalgoogle-vertex/us-east5 | $3.30 raw in $/1M | $16.50 raw out $/1M |
AWS Bedrock (1)
| AWS Bedrock | eu-central-1 (EU cross-region inference profile)EU | $3.30 raw in $/1M | $16.50 raw out $/1M |
T-Systems LLM Hub (1)
| T-Systems LLM Hub | euEU | $3.45 raw in $/1M | $17.26 raw out $/1M |