← Back to Leaderboard
MMistral | Voxtral Small 24b 2507
Voxtral Small is an enhancement of Mistral Small 3, incorporating state-of-the-art audio input capabilities while retaining best-in-class text performance. It excels at speech transcription, translation and audio understanding. Input audio is priced at $100 per million seconds.
Excellent
86.7
Most Recent TestHighly suitable for Great Commission work.
Strengths
- Strong task completion capability
- Maintains doctrinal fidelity
- Excellent at 1.2. Evangelistic Material
- Excellent at 1.3. Apologetics
- Excellent at 1.5. Intercessory Prayer
Weaknesses
- Struggles with 3.1. Existence of God
Overall Score
86.7
Tier 1 (Task) 70%
88.6
Tier 2 (Doctrine) 20%
86.7
Tier 3 (Worldview) 10%
73.3
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description
Voxtral Small is an enhancement of Mistral Small 3, incorporating state-of-the-art audio input capabilities while retaining best-in-class text performance. It excels at speech transcription, translation and audio understanding. Input audio is priced at $100 per million seconds.
Provider
Mistral
Model ID
mistralai/voxtral-small-24b-2507
Tests Run
1
Categories
Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
73
1.1
97
1.2
100
1.3
77
1.4
93
1.5
87
1.6
93
1.7
100
2.1
80
2.2
90
2.3
80
2.4
80
2.5
90
2.6
25
3.1
100
3.2
63
3.3
100
3.4
75
3.5
83
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession
Recent Tests
Recent Test Runs
| Date | Score | Version | Tier 1 (Task) | Tier 2 (Gospel) | Tier 3 (Worldview) | Trust Tier |
|---|---|---|---|---|---|---|
| 10/10/2026 | 86.7 | 1.0.0 | 88.6 | 86.7 | 73.3 | automated |