← Back to Leaderboard

M
Mistral | Mistral Saba

Mistral Saba is a 24B-parameter language model specifically designed for the Middle East and South Asia, delivering accurate and contextually relevant responses while maintaining efficient performance. Trained on curated regional datasets, it supports multiple Indian-origin languages—including Tamil and Malayalam—alongside Arabic. This makes it a versatile option for a range of regional and multilingual applications. Read more at the blog post [here](https://mistral.ai/en/news/mistral-saba)

Compare

Excellent

88.0
Most Recent Test

Highly suitable for Great Commission work.

Strengths

  • Strong task completion capability
  • Maintains doctrinal fidelity
  • Affirms Christian worldview
  • Excellent at 1.2. Evangelistic Material
  • Excellent at 1.3. Apologetics

Weaknesses

No notable weaknesses identified

Overall Score
88.0
Tier 1 (Task) 70%
92.4
Tier 2 (Doctrine) 20%
75.0
Tier 3 (Worldview) 10%
83.3
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Mistral Saba is a 24B-parameter language model specifically designed for the Middle East and South Asia, delivering accurate and contextually relevant responses while maintaining efficient performance. Trained on curated regional datasets, it supports multiple Indian-origin languages—including Tamil and Malayalam—alongside Arabic. This makes it a versatile option for a range of regional and multilingual applications. Read more at the blog post [here](https://mistral.ai/en/news/mistral-saba)

Provider

Mistral

Model ID

mistralai/mistral-saba

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
73
1.1
100
1.2
100
1.3
90
1.4
93
1.5
100
1.6
90
1.7
100
2.1
100
2.2
80
2.3
50
2.4
50
2.5
70
2.6
75
3.1
100
3.2
75
3.3
100
3.4
100
3.5
67
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/13/202688.01.0.092.475.083.3automated