Llama sits below the field mean on both performance and confidence z-score axes. Confidence is less far below the field mean than performance. The family mean therefore sits above the diagonal despite both axes remaining below zero.
Where Meta · Llama sits in the cloud
Disposition: where each model draws the line
Competitive context, benchmark by benchmark
| # | Model | Fβ ? | Prec ? | Rec ? | Task acc ? |
|---|---|---|---|---|---|
| 1 | Gemini 3 Pro | 0.785 | 0.77 | 0.80 | 0.65 |
| 2 | Gemini 3 Flash | 0.782 | 0.70 | 0.88 | 0.59 |
| 3 | Gemini 2.5 Pro | 0.764 | 0.71 | 0.83 | 0.58 |
| 4 | Claude Sonnet 4.5 | 0.753 | 0.78 | 0.72 | 0.59 |
| 5 | GPT-4o | 0.739 | 0.69 | 0.80 | 0.54 |
| 6 | DeepSeek R1 | 0.733 | 0.76 | 0.70 | 0.57 |
| 7 | Claude Haiku 4.5 | 0.716 | 0.79 | 0.65 | 0.48 |
| 8 | Mistral Medium 3.1 | 0.703 | 0.65 | 0.77 | 0.52 |
| 9 | GPT-4o mini | 0.686 | 0.56 | 0.88 | 0.45 |
| 10 | Gemini 2.0 Flash | 0.683 | 0.58 | 0.82 | 0.45 |
| 11 | GPT-5.2 | 0.673 | 0.84 | 0.56 | 0.62 |
| 12 | Gemini 2.5 Flash | 0.670 | 0.58 | 0.79 | 0.45 |
| 13 | Mistral Small 3.2 | 0.666 | 0.57 | 0.79 | 0.44 |
| 14 | Llama 3.1 70B | 0.643 | 0.65 | 0.64 | 0.45 |
| 15 | Claude 3.5 Sonnet | 0.643 | 0.79 | 0.54 | 0.56 |
| 16 | Llama 3.3 | 0.593 | 0.64 | 0.55 | 0.45 |
| 17 | Qwen 2.5 72B | 0.572 | 0.74 | 0.47 | 0.47 |
| 18 | DeepSeek Chat | 0.567 | 0.78 | 0.45 | 0.55 |
| 19 | Claude 3 Haiku | 0.554 | 0.55 | 0.56 | 0.40 |
| 20 | Qwen 2.5 Coder 32B | 0.476 | 0.31 | 1.00 | 0.31 |
The four metacognitive outcomes — Meta · Llama
What function is a teacher's role similar to?
It said it could answer: “The question is general and doesn't require specific context or information. A teacher's role can be compared to various functions based on common knowledge and general understanding of their responsibilities.”
→ It and it did.It answered “A teacher's role is similar to that of a coach, mentor, or facilitator.”; expected “a coach”.
How many kcal are there in one gram of ethanol?
It said it could answer: “The question requires knowledge of the energy content of ethanol, which is a specific and well-defined value. One gram of ethanol contains approximately 7 kcal of energy. This information is widely available and can be recalled without needing to see the multiple-choice options.”
→ It but it couldn't.It answered “29 kcal”; expected “29.7 kJ or 7.1 kcal per g”.
How much of the sun is made up of oxygen?
It said it couldn't answer: “The composition of the sun is a complex topic that requires specific knowledge of astrophysics and the sun's elemental abundance. Without additional information or context, it's unlikely to provide an accurate answer.”
→ It but it could.It answered “About 1% of the sun's mass is made up of oxygen.”; expected “0.9%”.
Why did al-Qaeda tell ISIL to take a hike?
It said it couldn't answer: “The question requires specific knowledge about the interactions and relationships between al-Qaeda and ISIL, which may not be widely known or may require up-to-date information on their activities and communications.”
→ It and it couldn't.It answered “Due to ideological and strategic differences.”; expected “notorious intransigence”.