TestsBenchmarks · Tool use
τ³-bench Banking
τ³-bench banking domain with agentic retrieval (Sierra).
Measured by independent testersIndependent Reported by the makerVendor-reported
| Thinking levelSetting | |||||||
|---|---|---|---|---|---|---|---|
| 1 | Muse Glimmer 30B | Meta (Meta Superintelligence Labs, Muse) | 23.5% | HighHigh reasoning | Maker's own figureVendor-reportedMeta ↗ | — | 10 Aug 2026 |
| 2 | Mistral Medium 3.5 | Mistral AI | 13.4% | Highmaximum reasoning settings (reasoning_effort=high) | Maker's own figureVendor-reportedMistral AI ↗ | — | 22 May 2026 |
| 3 | Mistral Small 4 | Mistral AI | 7.0% | Defaultreasoning setting not stated | Maker's own figureVendor-reportedMistral AI ↗ | — | 22 May 2026 |