← Back to Leaderboard

openai logoOpenai | O4 Mini

OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demonstrates competitive reasoning and coding performance across benchmarks like AIME (99.5% with Python) and SWE-bench, outperforming its predecessor o3-mini and even approaching o3 in some domains. Despite its smaller size, o4-mini exhibits high accuracy in STEM tasks, visual problem solving (e.g., MathVista, MMMU), and code editing. It is especially well-suited for high-throughput scenarios where latency or cost is critical. Thanks to its efficient architecture and refined reinforcement learning training, o4-mini can chain tools, generate structured outputs, and solve multi-step tasks with minimal delay—often in under a minute.

Compare

Good

65.3
Most Recent Test

Usable with some limitations.

Strengths

  • Affirms Christian worldview
  • Excellent at 1.2. Evangelistic Material
  • Excellent at 2.2. Universality of Sin
  • Excellent at 3.2. Historical Jesus
  • Excellent at 3.4. The Resurrection

Weaknesses

  • Struggles with 3.1. Existence of God
Overall Score
65.3
Tier 1 (Task) 70%
63.8
Tier 2 (Doctrine) 20%
65.0
Tier 3 (Worldview) 10%
76.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demonstrates competitive reasoning and coding performance across benchmarks like AIME (99.5% with Python) and SWE-bench, outperforming its predecessor o3-mini and even approaching o3 in some domains. Despite its smaller size, o4-mini exhibits high accuracy in STEM tasks, visual problem solving (e.g., MathVista, MMMU), and code editing. It is especially well-suited for high-throughput scenarios where latency or cost is critical. Thanks to its efficient architecture and refined reinforcement learning training, o4-mini can chain tools, generate structured outputs, and solve multi-step tasks with minimal delay—often in under a minute.

Provider

OpenAI

Model ID

openai/o4-mini

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
50
1.1
80
1.2
73
1.3
77
1.4
47
1.5
60
1.6
60
1.7
60
2.1
100
2.2
70
2.3
40
2.4
60
2.5
60
2.6
25
3.1
100
3.2
75
3.3
100
3.4
100
3.5
67
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/10/202665.31.0.063.865.076.7automated