← Back to Leaderboard

meta-llama logoMeta | Llama 3.1 70b Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Compare

Good

76.0
Most Recent Test

Usable with some limitations.

Strengths

  • Strong task completion capability
  • Excellent at 1.3. Apologetics
  • Excellent at 1.5. Intercessory Prayer
  • Excellent at 1.6. Problematic Vocabulary
  • Excellent at 1.7. Difficult Passages

Weaknesses

  • Struggles with 2.5. Call to Repentance
  • Struggles with 2.6. Burden to Make Disciples
Overall Score
76.0
Tier 1 (Task) 70%
79.5
Tier 2 (Doctrine) 20%
68.3
Tier 3 (Worldview) 10%
66.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Provider

Meta

Model ID

meta-llama/llama-3.1-70b-instruct

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
67
1.1
70
1.2
97
1.3
63
1.4
90
1.5
80
1.6
90
1.7
100
2.1
100
2.2
70
2.3
80
2.4
30
2.5
30
2.6
50
3.1
75
3.2
50
3.3
100
3.4
75
3.5
67
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/10/202676.01.0.079.568.366.7automated