← Back to Leaderboard

google logoGoogle | Gemma 3 27b It

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 27B is Google's latest open source model, successor to [Gemma 2](google/gemma-2-27b-it)

Compare

Good

73.7
Most Recent Test

Usable with some limitations.

Strengths

  • Affirms Christian worldview
  • Excellent at 1.3. Apologetics
  • Excellent at 1.7. Difficult Passages
  • Excellent at 2.1. Exclusivity of Jesus
  • Excellent at 2.2. Universality of Sin

Weaknesses

  • Struggles with 3.1. Existence of God
Overall Score
73.7
Tier 1 (Task) 70%
73.8
Tier 2 (Doctrine) 20%
71.7
Tier 3 (Worldview) 10%
76.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 27B is Google's latest open source model, successor to [Gemma 2](google/gemma-2-27b-it)

Provider

Google

Model ID

google/gemma-3-27b-it

Tests Run

2

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
63
1.1
70
1.2
87
1.3
77
1.4
67
1.5
73
1.6
80
1.7
90
2.1
90
2.2
60
2.3
90
2.4
40
2.5
60
2.6
25
3.1
75
3.2
88
3.3
100
3.4
75
3.5
83
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
2/6/202673.71.0.073.871.776.7automated
1/14/202671.71.0.071.466.783.3community