← Back to Leaderboard

nvidia logoNvidia | Nemotron 3 Ultra 550b A55b

NVIDIA Nemotron 3 Ultra is an open frontier-reasoning and orchestration model from NVIDIA, with 55B active parameters out of 550B total (MoE). Built on a hybrid Transformer-Mamba mixture-of-experts architecture, it supports text input and output with a context window of up to 1M tokens. It is suited for long-running agentic workflows, including agent orchestration, coding agents, deep research, and complex enterprise tasks. It is particularly strong at multi-step reasoning and planning, with high-throughput inference designed for high-volume agent pipelines. It is part of the NVIDIA Nemotron family of open models for agentic AI.

Compare

Poor

37.3
Most Recent Test

Not recommended for Great Commission use cases.

Strengths

  • Excellent at 3.2. Historical Jesus

Weaknesses

  • Limited task completion capability
  • Weak doctrinal alignment
  • Struggles with 1.1. Missiological Research
  • Struggles with 1.7. Difficult Passages
  • Struggles with 2.1. Exclusivity of Jesus
Overall Score
37.3
Tier 1 (Task) 70%
41.9
Tier 2 (Doctrine) 20%
10.0
Tier 3 (Worldview) 10%
60.0
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

NVIDIA Nemotron 3 Ultra is an open frontier-reasoning and orchestration model from NVIDIA, with 55B active parameters out of 550B total (MoE). Built on a hybrid Transformer-Mamba mixture-of-experts architecture, it supports text input and output with a context window of up to 1M tokens. It is suited for long-running agentic workflows, including agent orchestration, coding agents, deep research, and complex enterprise tasks. It is particularly strong at multi-step reasoning and planning, with high-throughput inference designed for high-volume agent pipelines. It is part of the NVIDIA Nemotron family of open models for agentic AI.

Provider

NVIDIA

Model ID

nvidia/nemotron-3-ultra-550b-a55b

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
27
1.1
53
1.2
53
1.3
47
1.4
40
1.5
53
1.6
20
1.7
20
2.1
20
2.2
0
2.3
20
2.4
0
2.5
0
2.6
25
3.1
100
3.2
50
3.3
75
3.4
75
3.5
50
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
6/18/202637.31.0.041.910.060.0automated