{"data":{"slug":"nvidia-h200","etype":"chip","name":"NVIDIA H200","cat":"GPU","subtitle":"Hopper with 141 GB of HBM3E — the memory upgrade inference was waiting for.","summary":"The H200 pairs the H100 die with 141 GB of HBM3E at 4.8 TB/s — 76% more capacity and 43% more bandwidth. Because LLM inference is usually memory-bound, that alone delivered up to ~2x serving throughput on large models without any new compute. It was the first product to ship HBM3E and bridged the gap to Blackwell.","attrs":[{"g":"Overview","l":"Designer","v":"NVIDIA"},{"g":"Overview","l":"Architecture","v":"Hopper"},{"g":"Overview","l":"Announced","v":"November 2023; shipping from mid-2024"},{"g":"Overview","l":"Status","v":"Shipping"},{"b":"Vendor spec","g":"Manufacturing","l":"Foundry / process","v":"TSMC 4N"},{"b":"Vendor spec","g":"Memory","l":"Memory","v":"141 GB HBM3E"},{"b":"Vendor spec","g":"Memory","l":"Memory bandwidth","u":"TB/s","v":"4.8"},{"b":"Vendor spec","g":"Compute","l":"Compute","v":"Same published tensor throughput as H100 (FP8 dense 1,979 TFLOPS)"},{"b":"Vendor spec","g":"Power","l":"TDP","u":"W","v":"up to 700"},{"g":"Physical","l":"Form factors","v":"SXM5, NVL"},{"b":"Vendor spec","g":"Physical","l":"Interconnect","v":"NVLink 4 — 900 GB/s"}],"kf":{"node":"TSMC 4N","year":2024,"class":"GPU","tdp_w":700,"mem_bw":4.8,"memory":"141 GB HBM3E","designer":"NVIDIA"},"aliases":["H200","H200 SXM"],"ticker":null,"exchange":null,"hq":null,"founded":null,"website":null,"status":"Shipping","region":null,"asof":"2026-01-15","sources":[{"url":"https://www.nvidia.com/en-us/data-center/h200/","label":"NVIDIA H200 page"}]},"meta":{"found":true,"count":1,"served_from":"site cache (no live upstream calls)","as_of":"2026-10-14T11:46:16+00:00","disclaimer":"Research and information only — not investment advice. Structured records carry basis labels (vendor spec / reported / estimate); market quotes are delayed/indicative.","attribution":"Records compiled from vendor documentation, official filings and reputable public reporting; market quotes via financial data providers. See /data-sources."}}