DeepSeek sits above the field mean on both performance and confidence z-score axes. Relative performance is higher than relative confidence at the family mean. The highlighted cloud therefore falls below the diagonal on the z-score map.
Where DeepSeek sits in the cloud
Disposition: where each model draws the line
Competitive context, benchmark by benchmark
| # | Model | Fβ ? | Prec ? | Rec ? | Task acc ? |
|---|---|---|---|---|---|
| 1 | Gemini 3 Pro | 0.785 | 0.77 | 0.80 | 0.65 |
| 2 | Gemini 3 Flash | 0.782 | 0.70 | 0.88 | 0.59 |
| 3 | Gemini 2.5 Pro | 0.764 | 0.71 | 0.83 | 0.58 |
| 4 | Claude Sonnet 4.5 | 0.753 | 0.78 | 0.72 | 0.59 |
| 5 | GPT-4o | 0.739 | 0.69 | 0.80 | 0.54 |
| 6 | DeepSeek R1 | 0.733 | 0.76 | 0.70 | 0.57 |
| 7 | Claude Haiku 4.5 | 0.716 | 0.79 | 0.65 | 0.48 |
| 8 | Mistral Medium 3.1 | 0.703 | 0.65 | 0.77 | 0.52 |
| 9 | GPT-4o mini | 0.686 | 0.56 | 0.88 | 0.45 |
| 10 | Gemini 2.0 Flash | 0.683 | 0.58 | 0.82 | 0.45 |
| 11 | GPT-5.2 | 0.673 | 0.84 | 0.56 | 0.62 |
| 12 | Gemini 2.5 Flash | 0.670 | 0.58 | 0.79 | 0.45 |
| 13 | Mistral Small 3.2 | 0.666 | 0.57 | 0.79 | 0.44 |
| 14 | Llama 3.1 70B | 0.643 | 0.65 | 0.64 | 0.45 |
| 15 | Claude 3.5 Sonnet | 0.643 | 0.79 | 0.54 | 0.56 |
| 16 | Llama 3.3 | 0.593 | 0.64 | 0.55 | 0.45 |
| 17 | Qwen 2.5 72B | 0.572 | 0.74 | 0.47 | 0.47 |
| 18 | DeepSeek Chat | 0.567 | 0.78 | 0.45 | 0.55 |
| 19 | Claude 3 Haiku | 0.554 | 0.55 | 0.56 | 0.40 |
| 20 | Qwen 2.5 Coder 32B | 0.476 | 0.31 | 1.00 | 0.31 |
The four metacognitive outcomes — DeepSeek
What did the Greek root pharmakos imply?
It said it could answer: “The Greek root 'pharmakos' is well-documented in linguistic and historical contexts. It originally referred to a scapegoat or a person who was ritually expelled or sacrificed to purify a community. Over time, it evolved to be associated with medicine and healing, leading to the modern term 'pharmacy.' This knowledge is based on established etymological and historical sources.”
→ It and it did.It answered “The Greek root pharmakos implied both "remedy" and "poison," reflecting its dual meaning of healing and harm. It also referred to a scapegoat or sacrificial victim in religious rituals.”; expected “sorcery or even poison”.
Of what is ozone a reactive part of oxygen?
It said it could answer: “Ozone is a reactive form of oxygen consisting of three oxygen atoms (O₃). It is a well-known chemical compound, and this information is fundamental in chemistry.”
→ It but it couldn't.It answered “Ozone (O₃) is a reactive form of oxygen composed of three oxygen atoms. It is distinct from the diatomic oxygen (O₂) that we breathe.”; expected “allotrope”.
In what venue did Super Bowl XIX take place?
It said it couldn't answer: “The question asks for the venue of Super Bowl XIX, which is a specific historical fact. Without additional information or access to external data, I cannot provide the correct answer.”
→ It but it could.It answered “Super Bowl XIX took place at Stanford Stadium in Stanford, California.”; expected “Stanford Stadium”.
What did BSkyB name their interactive service?
It said it couldn't answer: “The question asks for the name of BSkyB's interactive service, which is specific knowledge about a company's product. Without additional information or context, it is not possible to provide the correct answer.”
→ It and it couldn't.It answered “BSkyB named their interactive service Sky Interactive.”; expected “Sky Active”.