TestsBenchmarks · Agentic
AA Analyst Agent
Artificial Analysis agentic data-analyst tasks (pass@1).
% solvedHigher is betterCounts toward:Weights: Research & analysis ×0.5The test's websiteOfficial page ↗
Measured by independent testersIndependent Reported by the makerVendor-reported
| Thinking levelSetting | |||||||
|---|---|---|---|---|---|---|---|
| 1 | Gemini 3.7 Flash | Google (Gemini / DeepMind) | 60.0% | HighGemini 3.7 Flash (High) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 2 | Claude Fable 5.1 | Anthropic | 57.5% | MaxClaude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 3 | Claude Opus 5 | Anthropic | 53.8% | MaxClaude Opus 5 (Adaptive Reasoning, Max Effort) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 4 | GPT-6 Astra | OpenAI | 51.3% | MaxGPT-6 Astra (Max) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 5 | GPT-5.5 | OpenAI | 50.0% | Extra highGPT-5.5 (Xhigh) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 6 | Claude Fable 5 | Anthropic | 48.8% | MaxClaude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 7 | GPT-5.6 Sol | OpenAI | 47.5% | MaxGPT-5.6 Sol (Max) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 8 | Qwen3.8 Max (0902) | Qwen (Alibaba) | 45.0% | DefaultQwen3.8 Max (0902) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 9 | Kimi K3 | Moonshot AI (Kimi) | 38.8% | MaxKimi K3 (Max) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 10 | Step 5 Preview | StepFun | 35.0% | DefaultStep 5 Preview | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 11 | Inkling | Thinking Machines Lab | 23.8% | Extra highInkling (Xhigh) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 12 | Mistral Medium 3.5 | Mistral AI | 12.5% | DefaultMistral Medium 3.5 | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 13 | MiniMax M3 | MiniMax | 10.0% | DefaultMiniMax-M3 | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |
| 14 | Nemotron 3 Ultra | NVIDIA | 6.3% | DefaultNemotron 3 Ultra 550B A55B (Reasoning) | Independent testIndependentArtificial Analysis ↗ | — | 1 Oct 2026 |