τ³-bench Airline

τ³-bench airline domain (Sierra).

The best 2 · 2 models tested

Top 2 · best setting per model · 2 models, 2 results (0 independent)

Measured by independent testersIndependent Reported by the makerVendor-reported

τ³-bench Airline leaderboard
				Thinking levelSetting
1	Mistral Medium 3.5	Mistral AI	72.0%	Highmaximum reasoning settings (reasoning_effort=high)	Maker's own figureVendor-reportedMistral AI ↗	—	22 May 2026
2	Mistral Small 4	Mistral AI	38.5%	Defaultreasoning setting not stated	Maker's own figureVendor-reportedMistral AI ↗	—	22 May 2026