← Back to Leaderboard

google logoGoogle | Gemma 3 12b It

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 12B is the second largest in the family of Gemma 3 models after [Gemma 3 27B](google/gemma-3-27b-it)

Compare

Good

63.7
Most Recent Test

Usable with some limitations.

Strengths

  • Affirms Christian worldview
  • Excellent at 2.1. Exclusivity of Jesus
  • Excellent at 2.2. Universality of Sin
  • Excellent at 3.1. Existence of God
  • Excellent at 3.2. Historical Jesus

Weaknesses

  • Struggles with 2.3. Reality of Judgment
  • Struggles with 2.6. Burden to Make Disciples
Overall Score
63.7
Tier 1 (Task) 70%
61.0
Tier 2 (Doctrine) 20%
61.7
Tier 3 (Worldview) 10%
86.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 12B is the second largest in the family of Gemma 3 models after [Gemma 3 27B](google/gemma-3-27b-it)

Provider

Google

Model ID

google/gemma-3-12b-it

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
47
1.1
67
1.2
70
1.3
67
1.4
47
1.5
70
1.6
60
1.7
100
2.1
100
2.2
30
2.3
70
2.4
50
2.5
20
2.6
100
3.1
100
3.2
63
3.3
100
3.4
75
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202663.71.0.061.061.786.7automated