COLLIE

Constrained text generation / instruction following.

The best 2 · 2 models tested

Top 2 · best setting per model · 2 models, 2 results (0 independent)

Measured by independent testersIndependent Reported by the makerVendor-reported

COLLIE leaderboard
				Thinking levelSetting
1	Mistral Medium 3.5	Mistral AI	95.8%	Highmaximum reasoning settings (reasoning_effort=high)	Maker's own figureVendor-reportedMistral AI ↗	—	22 May 2026
2	Mistral Small 4	Mistral AI	62.9%	HighMistral Small 4 - High	Maker's own figureVendor-reportedMistral AI ↗	—	16 Mar 2026