Technical Research Brief • Dataset verified 2026-10-17

Quantifying AI Progress: What the October 2026 Leaderboard Actually Says

Frontier model progress is usually described with adjectives. This brief replaces adjectives with the current measurements: the Artificial Analysis Intelligence Index (v4.3.2), median output speed, time to first answer token, published token prices, and the weighted cost of running one full Intelligence Index task. All figures below were checked on 2026-10-17 and are the same numbers shown in the model table on the homepage.

Intelligence Leader
Claude Opus 5.5
Index 58 • $5.98 per AA task
Fastest Measured Model
388 t/s
Nemotron 3.5 Super VL
Best Open-Weights Model
MiMo V2.6 Pro
Index 46 • $0.43 / $0.87 per M
Frontier Input Price Span
$0.08 – $10.00
Input per million tokens across the top 12

Top 12 by Artificial Analysis Intelligence Index

Intelligence Index v4.3.2 • measured 2026-10-17
# Model & Vendor Intelligence Output Speed AA Cost / Task Cheapest Token Price Weights
1 Claude Opus 5.5 Anthropic 58 97 t/s $5.98 $4.00 / $20.00 per M Proprietary
2 Claude Sonnet 5.5 Anthropic 56 141 t/s $5.46 $2.00 / $10.00 per M Proprietary
3 Claude Fable 5.1 Anthropic 53 71 t/s $7.63 $10.00 / $50.00 per M Proprietary
4 GPT-6 Astra OpenAI 53 57 t/s $3.26 $10.00 / $50.00 per M Proprietary
5 Gemini 4 Argon Google 53 — $1.99 $2.00 / $10.00 per M Proprietary
6 GPT-6.1 Sol OpenAI 52 66 t/s $0.72 $2.00 / $10.00 per M Proprietary
7 Muse Wonder Meta 52 181 t/s $4.52 $4.00 / $20.00 per M Proprietary
8 Muse Spark 1.3 Meta 48 134 t/s $1.60 $1.25 / $4.25 per M Proprietary
9 Grok 4.7 SpaceXAI 46 93 t/s $3.74 $2.00 / $6.00 per M Proprietary
10 MiMo V2.6 Pro Xiaomi 46 48 t/s $0.13 $0.43 / $0.87 per M Open
11 GLM-5.3 Z.ai 45 81 t/s $2.01 $0.079 / $4.80 per M Open
12 Qwen3.8 Max Alibaba 45 38 t/s $5.41 $2.00 / $6.00 per M Proprietary

1. The Top of the Leaderboard Is Now a Cluster, Not a Single Model

The gap between the best and the tenth-best model on the Intelligence Index is small enough that token price, latency and task-specific behaviour decide more procurement conversations than raw benchmark rank. Claude Opus 5.5 leads at 58, but several models within a few points cost an order of magnitude less per task. That is the defining property of the October 2026 market: capability has clustered, and cost has not.

Reasoning effort is a price dial

Artificial Analysis measures the same model at multiple reasoning efforts. Claude Opus 5.5 moves from 58 at max effort to lower scores at medium and low effort, and its cost per task falls from $5.98 toward $5.98 as thinking tokens shrink. Picking an effort level is now as important as picking a model.

Latency is the hidden tax

Time to first answer token ranges from sub-second for small open models to several minutes for frontier reasoning models on hard tasks. A model that is three points smarter but ten times slower changes how a team works, not just what it pays.

Open weights closed most of the gap

MiMo V2.6 Pro scores 46 on the same index while publishing weights, and several open models are within single digits of the frontier at a fraction of the per-token price. Self-hosting is no longer a purely ideological choice.

2. Cost per Task Is the Metric That Matters

Price per million input tokens is easy to quote and easy to mislead with. The Intelligence Index cost per task accounts for input, cached input, cache writes, reasoning tokens and answer tokens, weighted by task type. The cheapest models on that metric are not always the models with the lowest sticker price.

Model Intelligence Cost / AA Task Cheapest Token Price
MiMo V2.6 Flash Xiaomi 38 $0.06 $0.14 / $0.28 per M
GPT-6 Luna OpenAI 38 $0.07 $0.10 / $0.50 per M
Tencent Hy3 Tencent 25 $0.07 $0.13 / $0.53 per M
Inkling Small Thinking Machines 26 $0.09 $0.45 / $1.20 per M
MiMo V2.6 Pro Xiaomi 46 $0.13 $0.43 / $0.87 per M
Nemotron 3.5 Super VL NVIDIA 26 $0.19 $0.10 / $0.40 per M
Claude Haiku 5.5 Anthropic 43 $0.21 $0.10 / $0.50 per M
Qwen3.7 Plus Alibaba 25 $0.22 $0.32 / $1.28 per M

Cost per task is measured by Artificial Analysis on a standardised suite; it is not a prediction of your repository's bill. Use it to rank models, then measure your own workload.

3. What Changed in 2026, in Practical Terms

  • Context windows normalised at 1M tokens. Most current frontier and mid-tier models now advertise roughly one million tokens, and long-context pricing is flat for several of them. The differentiator is retrieval fidelity, not the headline number.
  • Reasoning became a configurable SKU. The same model name can be served at low, medium, high and max effort, with different latency, token use and cost. Agent harnesses now expose those settings directly.
  • Cache pricing became a first-class cost lever. Anthropic reads cached tokens at 5% of base input on Opus 5.5 and Sonnet 5.5, and 2.5% on Fable 5.1. DeepSeek off-peak cache hits on V4.1 Flash cost $0.003 per million tokens. Long-lived repository contexts are dramatically cheaper when cached.
  • Peak pricing returned. DeepSeek runs two weekday peak windows (01:00–04:00 and 06:00–10:00 UTC) and charges double during them; everything else, including weekends, is off-peak. Scheduling batch agent runs is now a real cost decision.
  • Subscription caps became dollar-denominated. GitHub Copilot, Cursor, Command Code and others now meter in credits or usage pools rather than request counts, which makes effective cost per task more transparent — and more sensitive to model choice.
Key takeaway: the useful unit of comparison is no longer "best model" or "price per million tokens". It is cost per completed task at the quality bar your team actually needs, with latency and context fidelity as constraints. The tables above give you the measured inputs; your own task mix supplies the weights.
← Back to Models Comparison (39 Models) Check Live Peak Routing (/now) →