TestsBenchmarks · Tool use
Toolathlon-Verified
Verified subset of Toolathlon personal tool-use tasks.
Measured by independent testersIndependent Reported by the makerVendor-reported
| Thinking levelSetting | |||||||
|---|---|---|---|---|---|---|---|
| 1 | GLM-5.3-Flash | Z.ai (Zhipu) | 78.4% | Maxreasoning_effort=max (default) | Maker's own figureVendor-reportedZ.ai ↗ | — | 26 Aug 2026 |
| 2 | Kimi K3 | Moonshot AI (Kimi) | 76.5% | Maxreasoning_effort=max | Maker's own figureVendor-reportedMoonshot AI ↗ | — | 16 Jul 2026 |
| 3 | DeepSeek V4 Flash Vision Exp | DeepSeek | 75.9% | Maxreasoning_effort=max | Maker's own figureVendor-reportedDeepSeek ↗ | — | 21 Aug 2026 |
| 4 | Muse Spark 1.1 | Meta (Meta Superintelligence Labs, Muse) | 75.6% | Defaulteffort not stated | Maker's own figureVendor-reportedMeta ↗ | — | 9 Jul 2026 |
| 5 | DeepSeek V4 Pro (0813) | DeepSeek | 74.1% | Maxreasoning_effort=max | Maker's own figureVendor-reportedDeepSeek ↗ | — | 13 Aug 2026 |
| 6 | Qwen3.8 Flash | Qwen (Alibaba) | 73.5% | Defaultthinking (setting not stated) | Maker's own figureVendor-reportedQwen (Alibaba) ↗ | — | 26 Aug 2026 |
| 7 | GLM-5.3 | Z.ai (Zhipu) | 73.0% | Maxreasoning_effort=max | Maker's own figureVendor-reportedZ.ai ↗ | — | 14 Aug 2026 |
| 8 | Qwen3.8 Max (0803) | Qwen (Alibaba) | 72.5% | Defaultthinking (default reasoning_effort=xhigh; eval setting not stated) | Maker's own figureVendor-reportedQwen (Alibaba) ↗ | — | 3 Aug 2026 |
| 9 | DeepSeek V4 Flash (0731) | DeepSeek | 70.3% | Maxreasoning_effort=max | Maker's own figureVendor-reportedDeepSeek ↗ | — | 31 Jul 2026 |
| 10 | Qwen3.8 27B | Qwen (Alibaba) | 67.1% | Defaultthinking (default reasoning_effort=xhigh; eval setting not stated) | Maker's own figureVendor-reportedQwen (Alibaba) ↗ | — | 26 Aug 2026 |
| 11 | GLM-5.2 | Z.ai (Zhipu) | 59.9% | Maxsetting not stated (GLM-5.3 blog comparison column) | Maker's own figureVendor-reportedZ.ai ↗ | — | 14 Aug 2026 |
| 12 | DeepSeek V4 Pro (Preview, 0423) | DeepSeek | 55.9% | Defaultsetting not stated for preview columns | Maker's own figureVendor-reportedDeepSeek ↗ | — | 13 Aug 2026 |
| 13 | DeepSeek V4 Flash (Preview, 0423) | DeepSeek | 49.7% | Defaultsetting not stated for preview columns | Maker's own figureVendor-reportedDeepSeek ↗ | — | 13 Aug 2026 |
| 14 | Qwen3.7 Max | Qwen (Alibaba) | 49.7% | Defaultthinking (setting not stated) | Maker's own figureVendor-reportedQwen (Alibaba) ↗ | — | 3 Aug 2026 |
| 15 | Muse Spark | Meta (Meta Superintelligence Labs, Muse) | 49.4% | Defaulteffort not stated | Maker's own figureVendor-reportedMeta ↗ | — | 9 Jul 2026 |