← Back to Leaderboard

M
Mistral | Mistral Nemo

A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA. The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi. It supports function calling and is released under the Apache 2.0 license.

Compare

Excellent

84.7
Most Recent Test

Highly suitable for Great Commission work.

Strengths

  • Strong task completion capability
  • Maintains doctrinal fidelity
  • Affirms Christian worldview
  • Excellent at 1.2. Evangelistic Material
  • Excellent at 1.3. Apologetics

Weaknesses

No notable weaknesses identified

Overall Score
84.7
Tier 1 (Task) 70%
83.8
Tier 2 (Doctrine) 20%
86.7
Tier 3 (Worldview) 10%
86.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA. The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi. It supports function calling and is released under the Apache 2.0 license.

Provider

Mistral

Model ID

mistralai/mistral-nemo

Tests Run

2

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
70
1.1
97
1.2
87
1.3
70
1.4
90
1.5
87
1.6
87
1.7
90
2.1
90
2.2
80
2.3
90
2.4
100
2.5
70
2.6
75
3.1
100
3.2
75
3.3
75
3.4
100
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
2/7/202684.71.0.083.886.786.7automated
1/14/202681.71.0.083.878.373.3community