← Back to Leaderboard

google logoGoogle | Gemma 3 4b It

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling.

Compare

Fair

59.0
Most Recent Test

Significant guardrail issues may impede work.

Strengths

  • Affirms Christian worldview
  • Excellent at 2.2. Universality of Sin
  • Excellent at 3.1. Existence of God
  • Excellent at 3.2. Historical Jesus

Weaknesses

  • Struggles with 2.5. Call to Repentance
  • Struggles with 2.6. Burden to Make Disciples
Overall Score
59.0
Tier 1 (Task) 70%
58.1
Tier 2 (Doctrine) 20%
53.3
Tier 3 (Worldview) 10%
76.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling.

Provider

Google

Model ID

google/gemma-3-4b-it

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
60
1.1
53
1.2
50
1.3
67
1.4
53
1.5
70
1.6
53
1.7
50
2.1
100
2.2
70
2.3
70
2.4
10
2.5
20
2.6
100
3.1
100
3.2
75
3.3
75
3.4
75
3.5
50
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/13/202659.01.0.058.153.376.7automated