SimpleQA Verified (Epoch AI)
85 models with a score. Leader: Gemini 4 Argon with 76 %.
| Benchmark profile | |
|---|---|
| Task | allgemein - Faktenwissen ohne Hilfsmittel, Halluzinationsneigung |
| Metric | Anteil korrekt beantworteter Faktenfragen, bester Wert ueber die Bewerter |
| Direction | ↑ higher is better |
| Limitation | 🔴 Nicht das urspruengliche SimpleQA von OpenAI, sondern die bereinigte Fassung SimpleQA Verified. Misst Wissen AUS DEM GEDAECHTNIS - die Anreicherung soll gerade nicht aus dem Gedaechtnis ergaenzen, sondern bei der Vorlage bleiben (das misst HHEM). Grosse Modelle gewinnen hier strukturell. |
| As of | 15 Sept 2026 |
| Source | epoch.ai |
| Licence | CC BY 4.0 — Epoch AI |
Ranking (85)
No entry matches the filter.
| Model | Rank | Score | Developer | EU processing: InputEU in | EU processing: OutputEU out | all providers: Inputall in | all providers: Outputall out | Open weights | GPU memory (4-bit, derived)GPU memory |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 4 Argon | 1 | 76 % | €2.02 | €10.10 | €0.90 | €4.48 | – no | – | |
| GPT-6 astra | 2 | 75.6 % | OpenAI | €9.68 | €48.40 | €4.48 | €22.39 | – no | – |
| GPT-6.1 Sol | 3 | 73.9 % | OpenAI | €2.14 | €10.68 | €0.90 | €4.48 | – no | – |
| Gemini 3.1 Pro (Vorschau) | 4 | 73.5 % | – | – | €0.90 | €5.37 | – no | – | |
| Claude Opus 5.5 | 5 | 72.2 % | Anthropic | €3.92 | €19.58 | €1.79 | €8.96 | – no | – |
| Claude Fable 5.1 | 6 | 70.8 % | Anthropic | €9.90 | €49.50 | €4.48 | €22.39 | – no | – |
| Fable 5 | 7 | 70.7 % | Anthropic | – | – | €4.48 | €22.39 | – no | – |
| Gemini 3.8 Flash | 8 | 69.7 % | €0.74 | €3.68 | €0.34 | €1.68 | – no | – | |
| GPT-5.6 sol | 8 | 69.7 % | OpenAI | €3.94 | €19.70 | €1.79 | €8.96 | – no | – |
| Gemini 3.7 Flash | 10 | 69.2 % | €0.67 | €3.37 | €0.34 | €1.68 | – no | – | |
| Gemini 3 Flash Preview | 11 | 66.8 % | – | – | €0.22 | €1.34 | – no | – | |
| Gemini 3.5 Flash | 12 | 66.2 % | €1.48 | €8.89 | €0.67 | €4.03 | – no | – | |
| Gemini 3.6 Flash | 12 | 66.2 % | €0.67 | €3.37 | €0.34 | €1.68 | – no | – | |
| GPT-5.5 | 14 | 63 % | OpenAI | €4.93 | €29.56 | €2.24 | €13.43 | – no | – |
| Kimi K3.1 Pro | 15 | 62.2 % | Moonshot AI | €1.79 | €8.96 | €1.79 | €8.96 | – no | – |
| GPT-6 sol | 16 | 60.7 % | OpenAI | €2.15 | €10.75 | €0.90 | €4.48 | – no | – |
| Opus 5 | 17 | 59.9 % | Anthropic | €4.94 | €24.68 | €2.24 | €11.20 | – no | – |
| GPT-6.1 Terra | 18 | 57.3 % | OpenAI | €1.06 | €5.28 | €0.45 | €2.24 | – | – |
| Muse Spark Open | 19 | 56.6 % | – | – | – | €1.12 | €3.81 | – | – |
| Grok 4.7 | 20 | 56 % | xAI | – | – | €1.79 | €5.37 | – no | – |
| Qwen 3.7 Max | 21 | 55.8 % | Alibaba Cloud | – | – | €1.12 | €3.36 | – no | – |
| Opus 4.8 | 22 | 53 % | Anthropic | €4.88 | €24.40 | €2.24 | €11.20 | – no | – |
| DeepSeek V4 Pro 0813 | 23 | 52.9 % | DeepSeek | €1.79 | €3.58 | €1.16 | €2.33 | ✓ yes | from 912 GB |
| Opus 4.7 | 24 | 51.7 % | Anthropic | €4.88 | €24.40 | €2.24 | €11.20 | – no | – |
| Kimi K3 | 25 | 50.6 % | Moonshot AI | €2.55 | €12.76 | €1.66 | €8.51 | ✓ yes | from 1,533 GB |
| gpt-5 | 26 | 50.1 % | OpenAI | €0.62 | €4.93 | €0.56 | €4.48 | – no | – |
| GPT-5 2025-08-07 | 26 | 50.1 % | OpenAI | – | – | €0.56 | €4.48 | – no | – |
| o3 | 28 | 49.4 % | OpenAI | – | – | €0.90 | €3.58 | – no | – |
| o3 2025-04-16 | 28 | 49.4 % | OpenAI | €0.99 | €3.94 | €0.90 | €3.58 | – no | – |
| Grok 4.6 | 30 | 49.3 % | xAI | – | – | €1.79 | €5.37 | – no | – |
| Qwen3-Max | 31 | 48.75 % | Alibaba Cloud | – | – | – | – | – no | – |
| Grok 4.5 | 32 | 48.3 % | xAI | – | – | €1.79 | €5.37 | – no | – |
| gpt-5.1 | 33 | 48 % | OpenAI | €1.23 | €9.84 | €0.56 | €4.48 | – no | – |
| DeepSeek V4 Pro | 34 | 47 % | DeepSeek | €0.90 | €1.79 | €0.90 | €1.79 | ✓ yes | from 884 GB |
| Opus 4.6 | 34 | 47 % | Anthropic | €4.77 | €23.84 | €2.24 | €11.20 | – no | – |
| Sonnet 5.5 | 36 | 46.5 % | Anthropic | €2.02 | €10.10 | €0.90 | €4.48 | – no | – |
| GPT-5.4 Pro | 37 | 46.3 % | OpenAI | – | – | €13.43 | €80.61 | – no | – |
| Qwen3.8-Max | 38 | 45.8 % | Alibaba Cloud | €2.24 | €5.39 | €1.48 | €4.43 | ✓ yes | from 1,350 GB |
| Opus 4.5 | 39 | 45.7 % | Anthropic | €4.77 | €23.85 | €2.24 | €11.20 | – no | – |
| GPT-5.4 | 40 | 45.1 % | OpenAI | €2.60 | €13.87 | €1.12 | €6.72 | – no | – |
| Qwen 3.6 Plus | 41 | 44.1 % | Alibaba Cloud | – | – | €0.45 | €2.69 | – no | – |
| GPT-5.6 terra | 42 | 43.2 % | OpenAI | €1.97 | €11.82 | €0.90 | €5.37 | – no | – |
| DeepSeek V4.1 Flash 1017 | 43 | 42.5 % | DeepSeek | €0.18 | €0.54 | €0.18 | €0.54 | – no | – |
| GPT-6 luna | 44 | 41.4 % | OpenAI | €0.11 | €0.54 | €0.045 | €0.22 | – no | – |
| o1 2024-12-17 | 45 | 41.1 % | OpenAI | €14.78 | €59.11 | €13.43 | €53.74 | – no | – |
| glm-5.3 | 46 | 41 % | Z.ai | €0.45 | €1.79 | €0.18 | €0.57 | ✓ yes | from 419 GB |
| GPT-5.6 luna | 46 | 41 % | OpenAI | €0.20 | €1.18 | €0.09 | €0.54 | – no | – |
| Qwen 3 235B A22B Thinking 2507 | 48 | 40.4 % | Alibaba Cloud | – | – | €0.40 | €3.13 | ✓ yes | from 134 GB |
| GPT-5.2 | 49 | 37.1 % | OpenAI | €1.72 | €13.79 | €0.78 | €6.27 | – no | – |
| Kimi K2.7 Code | 50 | 36.5 % | Moonshot AI | €0.59 | €2.96 | €0.59 | €2.96 | ✓ yes | from 554 GB |
| Claude Sonnet 4.6 | 51 | 35.5 % | Anthropic | €2.87 | €14.31 | €1.34 | €6.72 | – no | – |
| Kimi K2.6 | 52 | 34.9 % | Moonshot AI | €0.43 | €2.67 | €0.35 | €1.61 | ✓ yes | from 569 GB |
| Kimi K2.5 (Retiring) | 53 | 34.3 % | Moonshot AI | €0.58 | €3.22 | €0.27 | €1.34 | ✓ yes | from 554 GB |
| glm-5.2 | 54 | 34.2 % | Z.ai | €0.81 | €2.91 | €0.15 | €0.48 | ✓ yes | from 419 GB |
| GLM 5.1 | 55 | 34 % | Z.ai | €1.24 | €3.90 | €0.81 | €2.60 | ✓ yes | from 419 GB |
| Claude Sonnet 5 | 56 | 33.7 % | Anthropic | €1.98 | €9.87 | €0.90 | €4.48 | – no | – |
| DeepSeek V4 Flash 0731 | 57 | 33.6 % | DeepSeek | €0.10 | €0.25 | €0.054 | €0.16 | ✓ yes | from 172 GB |
| Grok 4.3 | 58 | 33.2 % | xAI | – | – | €1.12 | €2.24 | – no | – |
| GLM 4.7 | 59 | 32.2 % | Z.ai | – | – | €0.27 | €0.99 | ✓ yes | from 201 GB |
| GPT-4.1 | 60 | 31.1 % | OpenAI | €1.97 | €7.87 | €0.90 | €3.58 | – no | – |
| GPT-4.1-2025-04-14 | 60 | 31.1 % | OpenAI | €0.99 | €3.94 | €0.90 | €3.58 | – no | – |
| Sonnet 4.5 | 62 | 30.7 % | Anthropic | €2.68 | €13.42 | €1.34 | €6.72 | – no | – |
| Grok 4.20 | 63 | 30.2 % | xAI | – | – | €1.27 | €2.53 | – no | – |
| Grok 4.20 Reasoning | 63 | 30.2 % | xAI | – | – | €1.12 | €2.24 | – no | – |
| grok-4.20-0309-reasoning | 63 | 30.2 % | xAI | – | – | €1.12 | €2.24 | – no | – |
| GPT-5.4 mini | 66 | 29.4 % | OpenAI | €0.74 | €4.43 | €0.34 | €2.02 | – no | – |
| GPT-4o | 67 | 26 % | OpenAI | €2.39 | €9.55 | €1.12 | €4.48 | – no | – |
| GPT-4o-2024-08-06 | 67 | 26 % | OpenAI | €1.23 | €4.93 | €1.12 | €4.48 | – no | – |
| Haiku 5.5 | 69 | 23.8 % | Anthropic | €0.10 | €0.51 | €0.045 | €0.22 | – no | – |
| GPT-5 mini | 70 | 21.6 % | OpenAI | €0.25 | €1.97 | €0.11 | €0.90 | – no | – |
| Qwen3.5-Flash | 71 | 20.32 % | Alibaba Cloud | – | – | – | – | – no | – |
| Mistral Large 4 | 72 | 20 % | Mistral AI | €0.50 | €1.75 | €0.50 | €1.75 | ✓ yes | from 582 GB |
| o4-mini 2025-04-16 | 73 | 19.6 % | OpenAI | €0.54 | €2.17 | €0.49 | €1.97 | – no | – |
| o3 mini 2025-01-31 | 74 | 15.3 % | OpenAI | €0.54 | €2.17 | €0.49 | €1.97 | – no | – |
| Claude Haiku 4.5 | 75 | 13.2 % | Anthropic | €0.89 | €4.47 | €0.45 | €2.24 | – no | – |
| gpt-4.1-mini | 76 | 12.7 % | OpenAI | €0.39 | €1.53 | €0.18 | €0.72 | – no | – |
| GPT-4.1-mini-2025-04-14 | 76 | 12.7 % | OpenAI | €0.20 | €0.79 | €0.18 | €0.72 | – no | – |
| Claude 3 Opus | 78 | 12.6 % | Anthropic | – | – | €6.72 | €33.59 | – | – |
| GPT-5 nano | 79 | 11.7 % | OpenAI | €0.049 | €0.39 | €0.022 | €0.18 | – no | – |
| GPT-5.4 nano | 79 | 11.7 % | OpenAI | – | – | €0.09 | €0.56 | – no | – |
| Gemma 4 31B | 81 | 10.4 % | €0.09 | €0.27 | €0.09 | €0.27 | ✓ yes | from 22 GB | |
| GPT-4o mini | 82 | 8.3 % | OpenAI | €0.14 | €0.57 | €0.067 | €0.27 | – no | – |
| GPT-4o-mini-0718 | 82 | 8.3 % | OpenAI | €0.15 | €0.59 | €0.067 | €0.27 | – no | – |
| gpt-4.1-nano | 84 | 6 % | OpenAI | €0.10 | €0.39 | €0.10 | €0.39 | – no | – |
| GPT-4.1-nano-2025-04-14 | 84 | 6 % | OpenAI | €0.049 | €0.20 | €0.045 | €0.18 | – no | – |
Equal scores share a rank. When filtering, the rank stays the position in the whole list. GPU memory “from …” is a lower bound (parameters × 0.55 GB + 4 GB). Prices: € per 1M tokens. Source: providers' pricing pages, read and checked by searchit. As of 7 Nov 2026.
Price and performance
Scores: SimpleQA Verified (Epoch AI), CC BY 4.0 — Epoch AI. Taken unchanged from the source.