TestsBenchmarks · writing
LLM Creative Story-Writing Benchmark (Lech Mazur)
Short stories to constrained briefs, compared pairwise by a panel of LLM evaluators; Thurstone comparison score centered at 0.
ScoreHigher is betterCounts toward:Weights: Writing & creativity ×0.7The test's websiteOfficial page ↗
Measured by independent testersIndependent Reported by the makerVendor-reported
| Thinking levelSetting | |||||||
|---|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.1 | Anthropic | 3.8 | HighClaude Fable 5.1 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 2 | Claude Opus 5 | Anthropic | 3.8 | Extra highClaude Opus 5 (xhigh) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 3 | Claude Opus 5.5 | Anthropic | 3.8 | HighClaude Opus 5.5 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 4 | GPT-6 Astra | OpenAI | 3.5 | HighGPT-6 Astra (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 5 | GLM-5.3 | Z.ai (Zhipu) | 3 | MaxGLM-5.3 (max) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 6 | Claude Fable 5 | Anthropic | 2.9 | HighClaude Fable 5 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 7 | GPT-5.6 Sol | OpenAI | 2.5 | Extra highGPT-5.6 Sol (xhigh) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 8 | Kimi K3 | Moonshot AI (Kimi) | 2.5 | DefaultKimi K3 | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 9 | GPT-5.5 | OpenAI | 2.5 | Extra highGPT-5.5 (xhigh) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 10 | GPT-5.4 | OpenAI | 2 | MediumGPT-5.4 (medium) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 11 | Claude Opus 4.7 | Anthropic | 1.8 | HighClaude Opus 4.7 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 12 | Claude Sonnet 4.6 | Anthropic | 1.7 | DefaultClaude Sonnet 4.6 Thinking 16K | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 13 | MiMo-V2.6-Pro | Xiaomi MiMo | 1.6 | DefaultXiaomi MiMo V2.6 Pro (thinking) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 14 | Claude Opus 4.6 | Anthropic | 1.1 | DefaultClaude Opus 4.6 Thinking 16K | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 15 | Claude Opus 4.8 | Anthropic | 0.8 | Extra highClaude Opus 4.8 (xhigh) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 16 | Muse Spark 1.1 | Meta (Meta Superintelligence Labs, Muse) | 0.8 | HighMuse Spark 1.1 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 17 | Muse Spark 1.3 | Meta (Meta Superintelligence Labs, Muse) | 0.6 | HighMuse Spark 1.3 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 18 | DeepSeek V4 Pro (0813) | DeepSeek | 0.5 | HighDeepSeek V4 Pro (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 19 | GLM-5.2 | Z.ai (Zhipu) | 0.5 | MaxGLM-5.2 (max) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 20 | Grok 4.7 | SpaceXAI (formerly xAI) | 0.4 | HighGrok 4.7 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 21 | Gemini 3.8 Flash | Google (Gemini / DeepMind) | 0.2 | HighGemini 3.8 Flash (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 22 | Qwen3.8 Max (0803) | Qwen (Alibaba) | 0.2 | DefaultQwen 3.8 Max | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 23 | Kimi K2.6 | Moonshot AI (Kimi) | 0.1 | DefaultKimi K2.6 | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 24 | Muse Spark 1.2 | Meta (Meta Superintelligence Labs, Muse) | -0 | HighMuse Spark 1.2 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 25 | MiniMax M3 | MiniMax | -0.1 | DefaultMiniMax-M3 | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 26 | DeepSeek V4.1 Flash | DeepSeek | -0.5 | HighDeepSeek V4.1 Flash (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 27 | DeepSeek V4 Pro (Preview, 0423) | DeepSeek | -0.5 | DefaultDeepSeek V4 Pro Preview | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 28 | Qwen3.8 27B | Qwen (Alibaba) | -0.6 | DefaultQwen3.8-27B | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 29 | MiMo-V2.5-Pro | Xiaomi MiMo | -0.7 | DefaultXiaomi MiMo V2.5 Pro | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 30 | Gemini 3.7 Flash | Google (Gemini / DeepMind) | -0.7 | HighGemini 3.7 Flash (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 31 | Qwen3.6 Max Preview | Qwen (Alibaba) | -0.9 | DefaultQwen 3.6 Max Preview | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 32 | GLM-5.1 | Z.ai (Zhipu) | -1 | DefaultGLM-5.1 | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 33 | Kimi K2.5 | Moonshot AI (Kimi) | -1.1 | DefaultKimi K2.5 Thinking | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 34 | Gemma 4 31B IT | Google (Gemini / DeepMind) | -1.9 | DefaultGemma 4 31B Reasoning | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 35 | Gemini 3.5 Flash | Google (Gemini / DeepMind) | -2 | DefaultGemini 3.5 Flash | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 36 | Gemini 3.1 Pro (Preview) | Google (Gemini / DeepMind) | -2.2 | DefaultGemini 3.1 Pro Preview | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 37 | Qwen3.6 Plus | Qwen (Alibaba) | -2.3 | DefaultQwen 3.6 Plus | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 38 | Mistral Medium 3.5 | Mistral AI | -2.5 | DefaultMistral Medium 3.5 | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 39 | Qwen3.7 Max | Qwen (Alibaba) | -2.6 | DefaultQwen 3.7 Max | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 40 | Grok 4.6 | SpaceXAI (formerly xAI) | -2.8 | HighGrok 4.6 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 41 | gpt-oss-120b | OpenAI | -3.1 | DefaultGPT-OSS-120B | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 42 | MiniMax M2.7 | MiniMax | -3.8 | DefaultMiniMax-M2.7 | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 43 | Grok 4.3 | SpaceXAI (formerly xAI) | -4.2 | DefaultGrok 4.3 | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |
| 44 | Grok 4.5 | SpaceXAI (formerly xAI) | -5.1 | HighGrok 4.5 (high) | Independent testIndependentLech Mazur (LLM Creative Story-Writing Benchmark) ↗ | — | 28 Sep 2026 |