TestsBenchmarks · Tool use
τ³-bench Telecom
τ³-bench telecom domain (Sierra).
Measured by independent testersIndependent Reported by the makerVendor-reported
| Thinking levelSetting | |||||||
|---|---|---|---|---|---|---|---|
| 1 | Mistral Medium 3.5 | Mistral AI | 91.4% | Highmaximum reasoning settings (reasoning_effort=high) | Maker's own figureVendor-reportedMistral AI ↗ | — | 22 May 2026 |
| 2 | Mistral Small 4 | Mistral AI | 47.1% | Defaultreasoning setting not stated | Maker's own figureVendor-reportedMistral AI ↗ | — | 22 May 2026 |