← Back to Leaderboard

Q
Qwen | Qwen3 Coder

Qwen3-Coder-480B-A35B-Instruct is a Mixture-of-Experts (MoE) code generation model developed by the Qwen team. It is optimized for agentic coding tasks such as function calling, tool use, and long-context reasoning over repositories. The model features 480 billion total parameters, with 35 billion active per forward pass (8 out of 160 experts). Pricing for the Alibaba endpoints varies by context length. Once a request is greater than 128k input tokens, the higher pricing is used.

Compare

Fair

52.7
Most Recent Test

Significant guardrail issues may impede work.

Strengths

No notable strengths identified

Weaknesses

  • Weak doctrinal alignment
  • Resists worldview confession
  • Struggles with 1.1. Missiological Research
  • Struggles with 1.3. Apologetics
  • Struggles with 2.5. Call to Repentance
Overall Score
52.7
Tier 1 (Task) 70%
55.2
Tier 2 (Doctrine) 20%
46.7
Tier 3 (Worldview) 10%
46.7
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Qwen3-Coder-480B-A35B-Instruct is a Mixture-of-Experts (MoE) code generation model developed by the Qwen team. It is optimized for agentic coding tasks such as function calling, tool use, and long-context reasoning over repositories. The model features 480 billion total parameters, with 35 billion active per forward pass (8 out of 160 experts). Pricing for the Alibaba endpoints varies by context length. Once a request is greater than 128k input tokens, the higher pricing is used.

Provider

Qwen

Model ID

qwen/qwen3-coder

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
37
1.1
60
1.2
33
1.3
63
1.4
60
1.5
70
1.6
63
1.7
60
2.1
40
2.2
60
2.3
70
2.4
20
2.5
30
2.6
25
3.1
75
3.2
50
3.3
0
3.4
50
3.5
67
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202652.71.0.055.246.746.7automated