Skip to content
Bencher

TestsBenchmarks · Long context

Artificial Analysis output speed

Median output tokens per second on the first-party API, measured by Artificial Analysis (unit is tokens/sec).

Tokens per secondHigher is betterThe test's websiteOfficial page ↗

The best 15 · 56 models tested

Top 15 · best setting per model · 56 models, 101 results (101 independent)

Measured by independent testersIndependent Reported by the makerVendor-reported
Artificial Analysis output speed leaderboard
Thinking levelSetting
1Nemotron 3.5 Lightning 30B-A3BNVIDIA298 tok/sDefaultNemotron 3.5 LightningIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
2Gemini 3.7 FlashGoogle (Gemini / DeepMind)291 tok/sHighGemini 3.7 Flash (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
3Muse Spark 1.2Meta (Meta Superintelligence Labs, Muse)226 tok/sExtra highMuse Spark 1.2 (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
4Gemini 3.8 FlashGoogle (Gemini / DeepMind)221 tok/sHighGemini 3.8 Flash (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
5DeepSeek V4 Flash Vision ExpDeepSeek211 tok/sMaxDeepSeek V4 Flash Vision (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
6DeepSeek V4.1 FlashDeepSeek209 tok/sMaxDeepSeek V4.1 Flash (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
7Command A+Cohere208 tok/sDefaultCommand A+Independent testIndependentArtificial Analysis ↗—1 Oct 2026
8DeepSeek V4 Flash (0731)DeepSeek204 tok/sMaxDeepSeek V4 Flash 0731 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
9Mistral Small 4Mistral AI183 tok/sHighMistral Small 4 (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
10Gemini 3.5 FlashGoogle (Gemini / DeepMind)180 tok/sMediumGemini 3.5 Flash (Medium)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
11Gemini 3.6 FlashGoogle (Gemini / DeepMind)177 tok/sHighGemini 3.6 Flash (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
12gpt-oss-20bOpenAI174 tok/sHighgpt-oss-20b (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
13Muse Spark 1.3Meta (Meta Superintelligence Labs, Muse)174 tok/sMaxMuse Spark 1.3 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
14gpt-oss-120bOpenAI167 tok/sHighgpt-oss-120b (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
15Mistral Medium 3.5Mistral AI165 tok/sDefaultMistral Medium 3.5Independent testIndependentArtificial Analysis ↗—1 Oct 2026
16Nemotron 3 Super 120B A12BNVIDIA163 tok/sDefaultNemotron 3 Super 120B A12B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
17Nemotron 3 UltraNVIDIA155 tok/sDefaultNemotron 3 Ultra 550B A55B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
18Muse Glimmer 30BMeta (Meta Superintelligence Labs, Muse)146 tok/sHighMuse Glimmer (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
19Claude Sonnet 5.5Anthropic139 tok/sMaxClaude Sonnet 5.5 (Adaptive Reasoning, Max Effort, Default Fallback)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
20GPT-6 LunaOpenAI131 tok/sExtra highGPT-6 Luna (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
21Qwen3.6 35B A3BQwen (Alibaba)125 tok/sDefaultQwen3.6 35B A3B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
22GPT-5.6 LunaOpenAI112 tok/sExtra highGPT-5.6 Luna (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
23GPT-5.4OpenAI95 tok/sExtra highGPT-5.4 (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
24MiniMax M3MiniMax91 tok/sDefaultMiniMax-M3Independent testIndependentArtificial Analysis ↗—1 Oct 2026
25Claude Opus 5.5Anthropic90 tok/sMaxClaude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
26GPT-5.6 TerraOpenAI89 tok/sMaxGPT-5.6 Terra (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
27DeepSeek V4 Pro (0813)DeepSeek87 tok/sMaxDeepSeek V4 Pro 0813 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
28Hy3Tencent Hunyuan87 tok/sDefaultHy3Independent testIndependentArtificial Analysis ↗—1 Oct 2026
29GPT-5.5OpenAI86 tok/sExtra highGPT-5.5 (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
30Step 5 PreviewStepFun85 tok/sDefaultStep 5 PreviewIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
31GLM-5.2Z.ai (Zhipu)82 tok/sMaxGLM-5.2 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
32GPT-5.6 SolOpenAI79 tok/sMaxGPT-5.6 Sol (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
33Claude Sonnet 5Anthropic79 tok/sMaxClaude Sonnet 5 (Adaptive Reasoning, Max Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
34GPT-6 SolOpenAI74 tok/sMaxGPT-6 Sol (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
35Grok 4.7SpaceXAI (formerly xAI)73 tok/sHighGrok 4.7 (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
36Ministral 3 14BMistral AI73 tok/sDefaultMinistral 3 14BIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
37GLM-5.3Z.ai (Zhipu)69 tok/sLowGLM-5.3 (Low)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
38Claude Fable 5.1Anthropic68 tok/sMaxClaude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
39Granite 4.2 8BIBM Granite66 tok/sDefaultGranite 4.2 8BIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
40Grok 4.6SpaceXAI (formerly xAI)65 tok/sLowGrok 4.6 (Low)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
41GPT-6.1 SolOpenAI64 tok/sMaxGPT-6.1 Sol (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
42Claude Fable 5Anthropic63 tok/sMaxClaude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
43Claude Opus 4.8Anthropic59 tok/sMaxClaude Opus 4.8 (Adaptive Reasoning, Max Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
44Qwen3.8-Flash-NextQwen (Alibaba)57 tok/sDefaultQwen3.8-Flash-NextIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
45Grok 4.5SpaceXAI (formerly xAI)55 tok/sHighGrok 4.5 (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
46Claude Opus 5Anthropic53 tok/sHighClaude Opus 5 (Adaptive Reasoning, High Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
47MiMo-V2.6-FlashXiaomi MiMo51 tok/sDefaultMiMo-V2.6-FlashIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
48GPT-6 AstraOpenAI51 tok/sMaxGPT-6 Astra (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
49Claude Opus 4.7Anthropic46 tok/sMaxClaude Opus 4.7 (Adaptive Reasoning, Max Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
50GLM-5.3-FlashZ.ai (Zhipu)45 tok/sDefaultGLM 5.3 FlashIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
51Qwen3.8 27BQwen (Alibaba)45 tok/sExtra highQwen3.8 27B (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
52MiMo-V2.6-ProXiaomi MiMo42 tok/sDefaultMiMo-V2.6-ProIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
53Qwen3.8 2.4T A95B (open weights)Qwen (Alibaba)40 tok/sDefaultQwen3.8 2.4T A95BIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
54Qwen3.8 Max (0902)Qwen (Alibaba)39 tok/sDefaultQwen3.8 Max (0902)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
55Gemma 4 31B ITGoogle (Gemini / DeepMind)36 tok/sDefaultGemma 4 31B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
56Kimi K3Moonshot AI (Kimi)34 tok/sMaxKimi K3 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026