★
Menu
Home How It's Built Watchlist The Stack
Hardware ChipsCompare Chips Servers & SystemsNetworking MemoryFoundries & Packaging Cooling
Facilities Data CentersPower ProjectsCloud & GPU Compute
Intelligence AI ModelsSoftware AI ProductsBenchmarks Research PapersDatasets Concepts
Ecosystem CompaniesStocks PeopleTimeline TrendsFuture of AI
Learn News Ask the Data AI Agents
About About us Methodology Data & API Disclaimer
Options
DATA & API

Free read-only JSON access to the site's cached data.

Dark mode

Guided View
New to chips, data centers and model jargon? We explain key terms as you browse, in plain English. Same data, with the help built in.

Expert View
You already know the stack. Just the data: clean, fast and compact, with no extra explanations. This is the default view.

Interface language
‹ Back
Home › Servers & Systems › NVIDIA GB200 NVL72

NVIDIA GB200 NVL72

System Rack-Scale System Shipping

The rack that is the computer: 72 GPUs, one NVLink domain, 120 kW, liquid only.

You're looking at a system record: an assembled machine — a server or a whole rack — with what's inside it and where it's deployed.

The NVL72 abandoned the server as the unit of design: 18 compute trays (36 Grace CPUs + 72 B200 GPUs) and 9 NVLink-switch trays joined by a copper spine into a single 72-GPU coherent domain with 13.4 TB of HBM3E — presented to software as one enormous accelerator. At ~120 kW it made direct liquid cooling and 1,400 A busbars mandatory, forcing the data-center redesigns this site documents. GB300 NVL72 (Blackwell Ultra) is its 2025–26 successor.

Specifications & key facts

Each figure is labeled by basis: vendor spec, vendor claim, reported, estimate, or official. "Not publicly disclosed" means exactly that — we never invent values.

Overview

Configuration 36 × GB200 superchips: 72 GPUs + 36 Grace CPUsVendor spec
NVLink domain All 72 GPUs at 1.8 TB/s each — 130 TB/s aggregateVendor spec

Memory

HBM3E 13.4 TB per rack (+ ~17 TB LPDDR5X)Vendor spec

Compute

FP4 inference 1,440 PFLOPS (sparse, rack)Vendor spec

Power

Rack power ~120 kW — liquid cooling requiredVendor spec

How this connects to the rest of the stack

This record's links at a glance — click a group to jump to it.

Designed by

Interconnect & networking

Competes with

Sources

NVIDIA GB200 NVL72 ↗

Record reviewed as of 2026-01-15 — see Methodology.