← Back to Leaderboard

Q
Qwen | Qwen3.5 397b A17b

The Qwen3.5 series 397B-A17B native vision-language model is built on a hybrid architecture that integrates a linear attention mechanism with a sparse mixture-of-experts model, achieving higher inference efficiency. It delivers state-of-the-art performance comparable to leading-edge models across a wide range of tasks, including language understanding, logical reasoning, code generation, agent-based tasks, image understanding, video understanding, and graphical user interface (GUI) interactions. With its robust code-generation and agent capabilities, the model exhibits strong generalization across diverse agent.

Compare

Fair

57.7
Most Recent Test

Significant guardrail issues may impede work.

Strengths

  • Affirms Christian worldview
  • Excellent at 2.2. Universality of Sin
  • Excellent at 3.2. Historical Jesus
  • Excellent at 3.6. Salvation Through Faith

Weaknesses

  • Struggles with 1.1. Missiological Research
  • Struggles with 2.4. Lordship of Jesus
  • Struggles with 2.5. Call to Repentance
  • Struggles with 3.1. Existence of God
Overall Score
57.7
Tier 1 (Task) 70%
56.2
Tier 2 (Doctrine) 20%
53.3
Tier 3 (Worldview) 10%
76.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

The Qwen3.5 series 397B-A17B native vision-language model is built on a hybrid architecture that integrates a linear attention mechanism with a sparse mixture-of-experts model, achieving higher inference efficiency. It delivers state-of-the-art performance comparable to leading-edge models across a wide range of tasks, including language understanding, logical reasoning, code generation, agent-based tasks, image understanding, video understanding, and graphical user interface (GUI) interactions. With its robust code-generation and agent capabilities, the model exhibits strong generalization across diverse agent.

Provider

Qwen

Model ID

qwen/qwen3.5-397b-a17b

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
33
1.1
63
1.2
60
1.3
70
1.4
57
1.5
60
1.6
50
1.7
60
2.1
100
2.2
60
2.3
30
2.4
30
2.5
40
2.6
25
3.1
100
3.2
75
3.3
75
3.4
75
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/10/202657.71.0.056.253.376.7automated