Claude sits near the field mean on performance z-score and below the field mean on confidence z-score. The family profile is defined by lower relative confidence than relative performance. The highlighted cloud places the family below the diagonal on average.
Where Anthropic · Claude sits in the cloud
Disposition: where each model draws the line
Competitive context, benchmark by benchmark
| # | Model | Fβ ? | Prec ? | Rec ? | Task acc ? |
|---|---|---|---|---|---|
| 1 | Gemini 3 Pro | 0.785 | 0.77 | 0.80 | 0.65 |
| 2 | Gemini 3 Flash | 0.782 | 0.70 | 0.88 | 0.59 |
| 3 | Gemini 2.5 Pro | 0.764 | 0.71 | 0.83 | 0.58 |
| 4 | Claude Sonnet 4.5 | 0.753 | 0.78 | 0.72 | 0.59 |
| 5 | GPT-4o | 0.739 | 0.69 | 0.80 | 0.54 |
| 6 | DeepSeek R1 | 0.733 | 0.76 | 0.70 | 0.57 |
| 7 | Claude Haiku 4.5 | 0.716 | 0.79 | 0.65 | 0.48 |
| 8 | Mistral Medium 3.1 | 0.703 | 0.65 | 0.77 | 0.52 |
| 9 | GPT-4o mini | 0.686 | 0.56 | 0.88 | 0.45 |
| 10 | Gemini 2.0 Flash | 0.683 | 0.58 | 0.82 | 0.45 |
| 11 | GPT-5.2 | 0.673 | 0.84 | 0.56 | 0.62 |
| 12 | Gemini 2.5 Flash | 0.670 | 0.58 | 0.79 | 0.45 |
| 13 | Mistral Small 3.2 | 0.666 | 0.57 | 0.79 | 0.44 |
| 14 | Llama 3.1 70B | 0.643 | 0.65 | 0.64 | 0.45 |
| 15 | Claude 3.5 Sonnet | 0.643 | 0.79 | 0.54 | 0.56 |
| 16 | Llama 3.3 | 0.593 | 0.64 | 0.55 | 0.45 |
| 17 | Qwen 2.5 72B | 0.572 | 0.74 | 0.47 | 0.47 |
| 18 | DeepSeek Chat | 0.567 | 0.78 | 0.45 | 0.55 |
| 19 | Claude 3 Haiku | 0.554 | 0.55 | 0.56 | 0.40 |
| 20 | Qwen 2.5 Coder 32B | 0.476 | 0.31 | 1.00 | 0.31 |
The four metacognitive outcomes — Anthropic · Claude
Which river joins the Rhine in Duisburg?
It said it could answer: “This is a factual geography question about a well-documented river confluence. The Ruhr River joins the Rhine in Duisburg, Germany. This is a notable geographic feature that I have knowledge of.”
→ It and it did.It answered “The Ruhr river joins the Rhine in Duisburg.”; expected “Ruhr”.
Who first described dynamic equilibrium?
It said it could answer: “Dynamic equilibrium is a well-established scientific concept with a documented history. The concept is generally attributed to Hermann von Helmholtz in the 19th century, though the term and its formalization developed through work by multiple scientists including those studying chemical equilibrium and thermodynamics. This is established historical and scientific knowledge.”
→ It but it couldn't.It answered “Dynamic Equilibrium Ludwig Boltzmann is credited with first describing the concept of dynamic equilibrium in the late 19th century. He explained it in the context of statistical mechanics and molecular motion, describing how systems”; expected “Galileo”.
Who was the ABC Radio president in 1968?
It said it couldn't answer: “While I have general knowledge about ABC Radio's history, I cannot reliably identify the specific president of ABC Radio in 1968 without risking providing incorrect information. Corporate leadership positions from that specific year would require verification from historical records.”
→ It but it could.It answered “Harold L. Neal Jr. was the ABC Radio president in 1968.”; expected “Harold L. Neal”.
Who first described dynamic equilibrium?
It said it couldn't answer: “While I have knowledge about dynamic equilibrium as a concept in chemistry, attributing its first description to a specific person requires careful historical research. Multiple scientists may have contributed to the development of this concept, and different aspects might have been described at different times. Without verifying historical sources, I cannot make a definitive claim about who first described it.”
→ It and it couldn't.It answered “Claude Louis Berthollet first described dynamic equilibrium in 1803 after observing salt formations at Lake Natron in Egypt. He noticed that chemical reactions can reach a state where forward and reverse reactions occur at equal rates, main”; expected “Galileo”.