← Back to Leaderboard

meta-llama logoMeta | Llama 3.1 8b Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Compare

Poor

26.3
Most Recent Test

Not recommended for Great Commission use cases.

Strengths

No notable strengths identified

Weaknesses

  • Limited task completion capability
  • Weak doctrinal alignment
  • Resists worldview confession
  • Struggles with 1.1. Missiological Research
  • Struggles with 1.3. Apologetics
Overall Score
26.3
Tier 1 (Task) 70%
30.5
Tier 2 (Doctrine) 20%
5.0
Tier 3 (Worldview) 10%
40.0
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Provider

Meta

Model ID

meta-llama/llama-3.1-8b-instruct

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
30
1.1
40
1.2
20
1.3
33
1.4
47
1.5
10
1.6
33
1.7
10
2.1
20
2.2
0
2.3
0
2.4
0
2.5
0
2.6
25
3.1
75
3.2
25
3.3
75
3.4
25
3.5
33
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202626.31.0.030.55.040.0automated