← Back to Leaderboard

meta-llama logoMeta | Llama 4 Scout

Llama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimodal input (text and image) and multilingual output (text and code) across 12 supported languages. Designed for assistant-style interaction and visual reasoning, Scout uses 16 experts per forward pass and features a context length of 10 million tokens, with a training corpus of ~40 trillion tokens. Built for high efficiency and local or commercial deployment, Llama 4 Scout incorporates early fusion for seamless modality integration. It is instruction-tuned for use in multilingual chat, captioning, and image understanding tasks. Released under the Llama 4 Community License, it was last trained on data up to August 2024 and launched publicly on April 5, 2025.

Compare

Good

77.7
Most Recent Test

Usable with some limitations.

Strengths

  • Strong task completion capability
  • Excellent at 1.3. Apologetics
  • Excellent at 1.5. Intercessory Prayer
  • Excellent at 1.6. Problematic Vocabulary
  • Excellent at 1.7. Difficult Passages

Weaknesses

  • Struggles with 3.1. Existence of God
Overall Score
77.7
Tier 1 (Task) 70%
79.5
Tier 2 (Doctrine) 20%
73.3
Tier 3 (Worldview) 10%
73.3
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Llama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimodal input (text and image) and multilingual output (text and code) across 12 supported languages. Designed for assistant-style interaction and visual reasoning, Scout uses 16 experts per forward pass and features a context length of 10 million tokens, with a training corpus of ~40 trillion tokens. Built for high efficiency and local or commercial deployment, Llama 4 Scout incorporates early fusion for seamless modality integration. It is instruction-tuned for use in multilingual chat, captioning, and image understanding tasks. Released under the Llama 4 Community License, it was last trained on data up to August 2024 and launched publicly on April 5, 2025.

Provider

Meta

Model ID

meta-llama/llama-4-scout

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
63
1.1
73
1.2
90
1.3
63
1.4
90
1.5
87
1.6
90
1.7
90
2.1
80
2.2
70
2.3
100
2.4
60
2.5
40
2.6
25
3.1
75
3.2
63
3.3
75
3.4
100
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202677.71.0.079.573.373.3automated