Skip to content
Bencher

TestsBenchmarks · Knowledge

GPQA Diamond

Accuracy on 198 graduate-level, Google-proof science multiple-choice questions.

% solvedHigher is betterToo easy now: the top models all score near perfectSaturatedThe test's websiteOfficial page ↗

The best 15 · 70 models tested

Top 15 · best setting per model · 70 models, 116 results (93 independent)

Measured by independent testersIndependent Reported by the makerVendor-reported
GPQA Diamond leaderboard
Thinking levelSetting
1GPT-6 AstraOpenAI96.3%Extra highGPT-6 Astra (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
2Claude Sonnet 5.5Anthropic95.6%Maxclaude-sonnet-5-5_maxIndependent testIndependentEpoch AI ↗—29 Sep 2026
3Gemini 3.1 Pro (Preview)Google (Gemini / DeepMind)95.5%Highreasoning_effort=highIndependent testIndependentVals.ai ↗—1 Sep 2026
4GPT-6.1 SolOpenAI95.4%Maxgpt-6.1-sol_maxIndependent testIndependentEpoch AI ↗—29 Sep 2026
5Gemini 3.8 FlashGoogle (Gemini / DeepMind)95.3%HighGemini 3.8 Flash (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
6Grok 4.6SpaceXAI (formerly xAI)94.9%HighGrok 4.6 (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
7GPT-5.4 ProOpenAI94.6%Extra highgpt-5.4-pro-2026-03-05_xhighIndependent testIndependentEpoch AI ↗—20 Mar 2026
8GPT-5.6 SolOpenAI94.6%DefaultGPT-5.6 launch table (effort not stated; text cites max for headline results)Maker's own figureVendor-reportedOpenAI ↗—9 Jul 2026
9Gemini 3.7 FlashGoogle (Gemini / DeepMind)94.5%HighGemini 3.7 Flash (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
10GPT-6 SolOpenAI94.3%Maxgpt-6-sol_maxIndependent testIndependentEpoch AI ↗—22 Sep 2026
11Muse Spark 1.3Meta (Meta Superintelligence Labs, Muse)94.1%Extra highMuse Spark 1.3 (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
12GPT-5.5 ProOpenAI93.9%Extra highgpt-5.5-pro-pre-release_xhighIndependent testIndependentEpoch AI ↗—24 Apr 2026
13Claude Opus 5Anthropic93.7%Extra highClaude Opus 5 (Adaptive Reasoning, Xhigh Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
14Claude Fable 5.1Anthropic93.7%MaxClaude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
15GPT-5.5OpenAI93.6%DefaultGPT-5.6 launch table (effort not stated; text cites max for headline results)Maker's own figureVendor-reportedOpenAI ↗—9 Jul 2026
16Qwen3.8 2.4T A95B (open weights)Qwen (Alibaba)93.5%DefaultQwen3.8 2.4T A95BIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
17Kimi K3Moonshot AI (Kimi)93.5%MaxKimi K3 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
18Grok 4.5SpaceXAI (formerly xAI)93.1%HighGrok 4.5 (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
19MiniMax M3MiniMax92.9%DefaultMiniMax-M3Independent testIndependentArtificial Analysis ↗—1 Oct 2026
20GPT-5.6 TerraOpenAI92.9%DefaultGPT-5.6 launch table (effort not stated; text cites max for headline results)Maker's own figureVendor-reportedOpenAI ↗—9 Jul 2026
21Gemini 3.6 FlashGoogle (Gemini / DeepMind)92.8%HighGemini 3.6 Flash (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
22Qwen3.8 Max (0902)Qwen (Alibaba)92.8%DefaultQwen3.8 Max (0902)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
23DeepSeek V4 Pro (0813)DeepSeek92.8%MaxDeepSeek V4 Pro 0813 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
24Qwen3.8 Max (0803)Qwen (Alibaba)92.7%Extra highqwen3.8-max_xhighIndependent testIndependentEpoch AI ↗—4 Aug 2026
25Gemini 3.5 FlashGoogle (Gemini / DeepMind)92.7%Highreasoning_effort=highIndependent testIndependentVals.ai ↗—1 Sep 2026
26Claude Fable 5Anthropic92.6%MaxClaude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
27Gemini 3 ProGoogle (Gemini / DeepMind)92.6%Defaultgemini-3-pro-previewIndependent testIndependentEpoch AI ↗—19 Nov 2025
28Qwen3.8 Max (0803)Qwen (Alibaba)92.6%Defaultthinking (default reasoning_effort=xhigh; eval setting not stated)Maker's own figureVendor-reportedQwen (Alibaba) ↗—3 Aug 2026
29Qwen3.8-Flash-NextQwen (Alibaba)92.3%DefaultQwen3.8-Flash-NextIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
30GPT-5.6 LunaOpenAI92.3%DefaultGPT-5.6 launch table (effort not stated; text cites max for headline results)Maker's own figureVendor-reportedOpenAI ↗—9 Jul 2026
31Claude Opus 4.8Anthropic92.0%MaxClaude Opus 4.8 (Adaptive Reasoning, Max Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
32GPT-5.4OpenAI92.0%Extra highGPT-5.4 (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
33GLM-5.3Z.ai (Zhipu)91.7%MaxGLM-5.3 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
34Qwen3.8 FlashQwen (Alibaba)91.7%Defaultthinking (setting not stated)Maker's own figureVendor-reportedQwen (Alibaba) ↗—26 Aug 2026
35GPT-5.2OpenAI91.7%Extra highreasoning_effort=xhighIndependent testIndependentVals.ai ↗—1 Sep 2026
36Grok 4.3SpaceXAI (formerly xAI)91.4%DefaultIndependent testIndependentVals.ai ↗—1 Sep 2026
37Claude Opus 4.7Anthropic91.4%MaxClaude Opus 4.7 (Adaptive Reasoning, Max Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
38DeepSeek V4 Flash Vision ExpDeepSeek91.3%MaxDeepSeek V4 Flash Vision (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
39GLM-5.3-FlashZ.ai (Zhipu)91.2%DefaultGLM 5.3 FlashIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
40GLM-5.2Z.ai (Zhipu)91.2%Defaultthinking (effort not stated)Maker's own figureVendor-reportedZ.ai ↗—16 Jun 2026
41Claude Sonnet 5Anthropic91.1%MaxClaude Sonnet 5 (Adaptive Reasoning, Max Effort)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
42DeepSeek V4.1 FlashDeepSeek90.9%Maxreasoning_effort=100 (max)Maker's own figureVendor-reportedDeepSeek ↗—10 Sep 2026
43DeepSeek V4 Flash (0731)DeepSeek90.8%MaxDeepSeek V4 Flash 0731 (Max)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
44Qwen3.8 27BQwen (Alibaba)90.5%Extra highQwen3.8 27B (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
45Kimi K2.6Moonshot AI (Kimi)90.5%DefaultthinkingMaker's own figureVendor-reportedMoonshot AI ↗—20 Apr 2026
46Muse Spark 1.2Meta (Meta Superintelligence Labs, Muse)90.4%Extra highMuse Spark 1.2 (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
47Qwen3.6 PlusQwen (Alibaba)90.4%DefaultthinkingMaker's own figureVendor-reportedQwen (Alibaba) ↗—2 Apr 2026
48Qwen3.7 PlusQwen (Alibaba)90.3%DefaultthinkingMaker's own figureVendor-reportedQwen (Alibaba) ↗—21 May 2026
49Qwen3.7 MaxQwen (Alibaba)90.2%DefaultIndependent testIndependentVals.ai ↗—1 Sep 2026
50DeepSeek V4 Pro (Preview, 0423)DeepSeek90.1%MaxThink MaxMaker's own figureVendor-reportedDeepSeek ↗—24 Apr 2026
51Muse Spark 1.1Meta (Meta Superintelligence Labs, Muse)89.8%Extra highMuse Spark 1.1 (Xhigh)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
52Hy3Tencent Hunyuan89.7%DefaultHy3Independent testIndependentArtificial Analysis ↗—1 Oct 2026
53DeepSeek V4 Flash (Preview, 0423)DeepSeek88.1%MaxThink MaxMaker's own figureVendor-reportedDeepSeek ↗—24 Apr 2026
54Qwen3.6 27BQwen (Alibaba)87.8%DefaultthinkingMaker's own figureVendor-reportedQwen (Alibaba) ↗—22 Apr 2026
55Gemini 3.1 Flash-LiteGoogle (Gemini / DeepMind)86.9%HighMaker's own figureVendor-reportedGoogle ↗—3 Mar 2026
56Nemotron 3 UltraNVIDIA86.7%DefaultNemotron 3 Ultra 550B A55B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
57GLM-5.1Z.ai (Zhipu)86.2%DefaultthinkingMaker's own figureVendor-reportedZ.ai ↗—7 Apr 2026
58Gemma 4 31B ITGoogle (Gemini / DeepMind)85.7%DefaultGemma 4 31B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
59Qwen3.6 35B A3BQwen (Alibaba)84.1%DefaultQwen3.6 35B A3B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
60Muse Glimmer 30BMeta (Meta Superintelligence Labs, Muse)83.5%HighMuse Glimmer (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
61Gemma 4 26B A4B ITGoogle (Gemini / DeepMind)82.3%DefaultThinkingMaker's own figureVendor-reportedGoogle ↗—2 Apr 2026
62Nemotron 3 Super 120B A12BNVIDIA80.0%DefaultNemotron 3 Super 120B A12B (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
63gpt-oss-120bOpenAI78.2%Highgpt-oss-120b (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
64Mistral Small 4Mistral AI76.9%HighMistral Small 4 (Reasoning)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
65Command A+Cohere76.1%DefaultCommand A+Independent testIndependentArtificial Analysis ↗—1 Oct 2026
66Mistral Medium 3.5Mistral AI74.8%DefaultMistral Medium 3.5Independent testIndependentArtificial Analysis ↗—1 Oct 2026
67Nemotron 3.5 Lightning 30B-A3BNVIDIA74.3%DefaultNemotron 3.5 LightningIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
68gpt-oss-20bOpenAI68.8%Highgpt-oss-20b (High)Independent testIndependentArtificial Analysis ↗—1 Oct 2026
69Granite 4.2 8BIBM Granite63.1%DefaultGranite 4.2 8BIndependent testIndependentArtificial Analysis ↗—1 Oct 2026
70Ministral 3 14BMistral AI57.2%DefaultMinistral 3 14BIndependent testIndependentArtificial Analysis ↗—1 Oct 2026