← Back to Leaderboard

meta logoMeta | Muse Spark Open

Muse Spark Open is a coding-optimized open-weight model. Trained specifically for agentic coding workflows, it delivers higher first-attempt accuracy, reliable tool calling, and deep codebase understanding across the repos developers actually work in.

Compare

Fair

54.7
Most Recent Test

Significant guardrail issues may impede work.

Strengths

  • Affirms Christian worldview
  • Excellent at 2.2. Universality of Sin
  • Excellent at 3.4. The Resurrection
  • Excellent at 3.5. Universal Sinfulness
  • Excellent at 3.6. Salvation Through Faith

Weaknesses

  • Weak doctrinal alignment
  • Struggles with 1.7. Difficult Passages
  • Struggles with 2.5. Call to Repentance
  • Struggles with 2.6. Burden to Make Disciples
Overall Score
54.7
Tier 1 (Task) 70%
53.3
Tier 2 (Doctrine) 20%
46.7
Tier 3 (Worldview) 10%
80.0
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Muse Spark Open is a coding-optimized open-weight model. Trained specifically for agentic coding workflows, it delivers higher first-attempt accuracy, reliable tool calling, and deep codebase understanding across the repos developers actually work in.

Provider

Meta

Model ID

meta/muse-spark-open

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
40
1.1
67
1.2
63
1.3
53
1.4
50
1.5
70
1.6
30
1.7
60
2.1
80
2.2
70
2.3
40
2.4
20
2.5
10
2.6
50
3.1
75
3.2
75
3.3
100
3.4
100
3.5
83
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/16/202654.71.0.053.346.780.0automated