★
Menu
Home How It's Built Watchlist The Stack
Hardware ChipsCompare Chips Servers & SystemsNetworking MemoryFoundries & Packaging Cooling
Facilities Data CentersPower ProjectsCloud & GPU Compute
Intelligence AI ModelsSoftware AI ProductsBenchmarks Research PapersDatasets Concepts
Ecosystem CompaniesStocks PeopleTimeline TrendsFuture of AI
Learn News Ask the Data AI Agents
About About us Methodology Data & API Disclaimer
Options
DATA & API

Free read-only JSON access to the site's cached data.

Dark mode

Guided View
New to chips, data centers and model jargon? We explain key terms as you browse, in plain English. Same data, with the help built in.

Expert View
You already know the stack. Just the data: clean, fast and compact, with no extra explanations. This is the default view.

Interface language
‹ Back
Home › Technologies › High-Bandwidth Memory (HBM)

High-Bandwidth Memory (HBM)

Technology Memory

Stacked DRAM wired straight to the GPU — the scarcest commodity in AI.

You're looking at a technology record: a building block of AI hardware — what it does, who makes it, and which chips and systems use it.

HBM stacks DRAM dies vertically, connects them with thousands of through-silicon vias, and mounts the stack millimeters from the processor on a silicon interposer. The result is terabytes per second of bandwidth that ordinary DIMMs cannot approach — and because model inference is mostly memory-bound, HBM capacity and bandwidth, not FLOPS, usually decide real AI performance. Only SK hynix, Samsung and Micron make it, and supply has been sold out roughly a year ahead throughout the boom.

Specifications & key facts

Each figure is labeled by basis: vendor spec, vendor claim, reported, estimate, or official. "Not publicly disclosed" means exactly that — we never invent values.

Overview

Suppliers SK hynix, Samsung, Micron
Generations HBM (2015) → HBM2 → HBM2E → HBM3 → HBM3E → HBM4
Why it matters LLM inference throughput scales with memory bandwidth more than with compute

How this connects to the rest of the stack

Related · 6 High-Bandwidth Memory (HBM)

This record's links at a glance — click a group to jump to it.

Sources

JEDEC HBM standards ↗

Record reviewed as of 2026-01-15 — see Methodology.