Mistral sits below the field mean on both performance and confidence z-score axes. The family cloud spans both sides of the diagonal. The family mean is slightly below the diagonal because confidence sits lower than performance in aggregate.
Where Mistral sits in the cloud
Disposition: where each model draws the line
Competitive context, benchmark by benchmark
| # | Model | Fβ ? | Prec ? | Rec ? | Task acc ? |
|---|---|---|---|---|---|
| 1 | Gemini 3 Pro | 0.785 | 0.77 | 0.80 | 0.65 |
| 2 | Gemini 3 Flash | 0.782 | 0.70 | 0.88 | 0.59 |
| 3 | Gemini 2.5 Pro | 0.764 | 0.71 | 0.83 | 0.58 |
| 4 | Claude Sonnet 4.5 | 0.753 | 0.78 | 0.72 | 0.59 |
| 5 | GPT-4o | 0.739 | 0.69 | 0.80 | 0.54 |
| 6 | DeepSeek R1 | 0.733 | 0.76 | 0.70 | 0.57 |
| 7 | Claude Haiku 4.5 | 0.716 | 0.79 | 0.65 | 0.48 |
| 8 | Mistral Medium 3.1 | 0.703 | 0.65 | 0.77 | 0.52 |
| 9 | GPT-4o mini | 0.686 | 0.56 | 0.88 | 0.45 |
| 10 | Gemini 2.0 Flash | 0.683 | 0.58 | 0.82 | 0.45 |
| 11 | GPT-5.2 | 0.673 | 0.84 | 0.56 | 0.62 |
| 12 | Gemini 2.5 Flash | 0.670 | 0.58 | 0.79 | 0.45 |
| 13 | Mistral Small 3.2 | 0.666 | 0.57 | 0.79 | 0.44 |
| 14 | Llama 3.1 70B | 0.643 | 0.65 | 0.64 | 0.45 |
| 15 | Claude 3.5 Sonnet | 0.643 | 0.79 | 0.54 | 0.56 |
| 16 | Llama 3.3 | 0.593 | 0.64 | 0.55 | 0.45 |
| 17 | Qwen 2.5 72B | 0.572 | 0.74 | 0.47 | 0.47 |
| 18 | DeepSeek Chat | 0.567 | 0.78 | 0.45 | 0.55 |
| 19 | Claude 3 Haiku | 0.554 | 0.55 | 0.56 | 0.40 |
| 20 | Qwen 2.5 Coder 32B | 0.476 | 0.31 | 1.00 | 0.31 |
The four metacognitive outcomes — Mistral
What are some proposals to connect campuses?
It said it could answer: “The question is general and can be answered with common knowledge about typical proposals for connecting campuses, such as shuttle services, bike paths, or technological solutions.”
→ It and it did.It answered “1. Shuttle Services: Dedicated buses between campuses. 2. Bike/Lanes & Rentals: Bike paths and shared bike programs. 3. Pedestrian Walkways: Safe, covered paths for walking. 4. Light Rail/Trams: Public transit links. 5. Ca”; expected “new and enlarged bridges, a shuttle service and/or a tram.”.
Who built a castle in Newcastle in 1080?
It said it could answer: “The castle in Newcastle was built by William the Conqueror in 1080 as part of his efforts to control the region after the Norman Conquest of England. This is a well-documented historical fact.”
→ It but it couldn't.It answered “William the Conqueror built a castle in Newcastle in 1080.”; expected “Robert Curthose”.
What was suggested at the Symposium in 1967
It said it couldn't answer: “The question lacks specific context about the Symposium in 1967. Without knowing the event's topic, participants, or field (e.g., science, philosophy, politics), it's impossible to determine what was suggested.”
→ It but it could.It answered “The use of computers to automate the process of cataloging and retrieving information was suggested at the Symposium in 1967.”; expected “suggested it for use in the ARPANET”.
What was William Johnson's Iroquois name?
It said it couldn't answer: “William Johnson, a prominent British Superintendent of Indian Affairs in the 18th century, was given an Iroquois name, but the exact name is not widely known or documented in general knowledge. Additional research or specific historical sources would be required to provide the correct answer.”
→ It and it couldn't.It answered “William Johnson's Iroquois name was "Warrenstaden."”; expected “Warraghiggey, meaning "He who does great things."”.