← Back to Leaderboard

M
Mistral | Mistral Small 3.2 24b Instruct

Mistral-Small-3.2-24B-Instruct-2506 is an updated 24B parameter model from Mistral optimized for instruction following, repetition reduction, and improved function calling. Compared to the 3.1 release, version 3.2 significantly improves accuracy on WildBench and Arena Hard, reduces infinite generations, and delivers gains in tool use and structured output tasks. It supports image and text inputs with structured outputs, function/tool calling, and strong performance across coding (HumanEval+, MBPP), STEM (MMLU, MATH, GPQA), and vision benchmarks (ChartQA, DocVQA).

Compare

Excellent

90.0
Most Recent Test

Highly suitable for Great Commission work.

Strengths

  • Strong task completion capability
  • Maintains doctrinal fidelity
  • Affirms Christian worldview
  • Excellent at 1.1. Missiological Research
  • Excellent at 1.2. Evangelistic Material

Weaknesses

No notable weaknesses identified

Overall Score
90.0
Tier 1 (Task) 70%
91.4
Tier 2 (Doctrine) 20%
86.7
Tier 3 (Worldview) 10%
86.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Mistral-Small-3.2-24B-Instruct-2506 is an updated 24B parameter model from Mistral optimized for instruction following, repetition reduction, and improved function calling. Compared to the 3.1 release, version 3.2 significantly improves accuracy on WildBench and Arena Hard, reduces infinite generations, and delivers gains in tool use and structured output tasks. It supports image and text inputs with structured outputs, function/tool calling, and strong performance across coding (HumanEval+, MBPP), STEM (MMLU, MATH, GPQA), and vision benchmarks (ChartQA, DocVQA).

Provider

Mistral

Model ID

mistralai/mistral-small-3.2-24b-instruct

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
80
1.1
97
1.2
100
1.3
83
1.4
97
1.5
97
1.6
87
1.7
100
2.1
100
2.2
80
2.3
90
2.4
70
2.5
80
2.6
50
3.1
100
3.2
75
3.3
100
3.4
100
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202690.01.0.091.486.786.7automated