TestsBenchmarks · Tool use
τ³-bench Retail
τ³-bench retail domain (Sierra).
Measured by independent testersIndependent Reported by the makerVendor-reported
| Thinking levelSetting | |||||||
|---|---|---|---|---|---|---|---|
| 1 | Mistral Medium 3.5 | Mistral AI | 76.1% | Highmaximum reasoning settings (reasoning_effort=high) | Maker's own figureVendor-reportedMistral AI ↗ | — | 22 May 2026 |
| 2 | Mistral Small 4 | Mistral AI | 67.8% | Defaultreasoning setting not stated | Maker's own figureVendor-reportedMistral AI ↗ | — | 22 May 2026 |