TestsBenchmarks · Knowledge
EuroEval Swedish (generative)
Swedish-language rank score across sentiment, NER, linguistic acceptability, reading comprehension, summarisation (SweDN), knowledge (Skolprov) and common-sense tasks; lower is better.
Measured by independent testersIndependent Reported by the makerVendor-reported
Lower is better here: the shortest bar is the best result.
| Thinking levelSetting | |||||||
|---|---|---|---|---|---|---|---|
| 1 | GPT-6 Astra | OpenAI | 1.2 | Defaultgpt-6-astra (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 2 | Gemini 3.7 Flash | Google (Gemini / DeepMind) | 1.2 | Defaultgemini/gemini-3.7-flash (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 3 | GLM-5.3-Flash | Z.ai (Zhipu) | 1.3 | Defaultzai-org/GLM-5.3-Flash (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 4 | Gemini 3.6 Flash | Google (Gemini / DeepMind) | 1.3 | Defaultgemini/gemini-3.6-flash (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 5 | GPT-5.6 Sol | OpenAI | 1.3 | Defaultgpt-5.6-sol (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 6 | DeepSeek V4.1 Flash | DeepSeek | 1.4 | No reasoningdeepseek/deepseek-flash#no-thinking (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 7 | GPT-5.6 Terra | OpenAI | 1.5 | Defaultgpt-5.6-terra (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 8 | Gemini 3 Flash Preview | Google (Gemini / DeepMind) | 1.5 | Defaultgemini/gemini-3-flash-preview#thinking (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 9 | GPT-5.4 Mini | OpenAI | 1.5 | Highopenai/gpt-5.4-mini-2026-03-17#high (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 10 | Qwen3.6 27B | Qwen (Alibaba) | 1.5 | DefaultQwen/Qwen3.6-27B-FP8 (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 11 | Qwen3.8 27B | Qwen (Alibaba) | 1.6 | DefaultQwen/Qwen3.8-27B (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 12 | Gemma 4 31B IT | Google (Gemini / DeepMind) | 1.6 | Defaultgoogle/gemma-4-31B-it (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 13 | Claude Sonnet 4.6 | Anthropic | 1.6 | Defaultclaude-sonnet-4-6 (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 14 | GPT-5.6 Luna | OpenAI | 1.6 | Defaultopenai/gpt-5.6-luna (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 15 | Qwen3.5-35B-A3B | Qwen (Alibaba) | 1.6 | DefaultQwen/Qwen3.5-35B-A3B-FP8 (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 16 | Gemini 3.1 Flash-Lite | Google (Gemini / DeepMind) | 1.6 | Defaultgemini/gemini-3.1-flash-lite-preview (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 17 | Gemini 3.5 Flash-Lite | Google (Gemini / DeepMind) | 1.7 | Defaultgemini/gemini-3.5-flash-lite (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 18 | GPT-5.4 | OpenAI | 1.7 | No reasoningopenai/gpt-5.4-2026-03-05#none (zero-shot, val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 19 | Gemma 4 26B A4B IT | Google (Gemini / DeepMind) | 1.8 | Defaultgoogle/gemma-4-26B-A4B-it (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 20 | Gemma 4 12B IT | Google (Gemini / DeepMind) | 1.8 | Defaultgoogle/gemma-4-12B-it (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 21 | gpt-oss-120b | OpenAI | 1.8 | Defaultopenai/gpt-oss-120b (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 22 | gpt-oss-20b | OpenAI | 2 | Mediumopenai/gpt-oss-20b#medium | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 23 | Apertus 1.5 70B | Swiss AI Initiative (EPFL, ETH Zurich, CSCS) | 2.1 | Defaultswiss-ai/Apertus-v1.5-70B (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 24 | Ministral 3 14B | Mistral AI | 2.1 | Defaultmistralai/Ministral-3-14B-Instruct-2512 (val) | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |
| 25 | EuroLLM 22B Instruct (2512) | EuroLLM (UTTER project consortium) | 2.3 | Defaultutter-project/EuroLLM-22B-Instruct-2512 | Independent testIndependentEuroEval (Alexandra Institute) ↗ | — | 29 Sep 2026 |