GPT-3
AI Model
Historical
Historical
175 billion parameters and the discovery of in-context learning.
You're looking at an AI model record: who built it, what it can do, and the hardware and data behind it.
GPT-3 demonstrated that a large enough language model could perform tasks from a few examples in its prompt — no fine-tuning — launching the API business model and the scaling era. Trained on V100 clusters with 3.1×10²³ FLOP (disclosed), it is the ancestor of every product on this site's Models list.
Specifications & key facts
Each figure is labeled by basis: vendor spec, vendor claim, reported, estimate, or official. "Not publicly disclosed" means exactly that — we never invent values.
Overview
Training compute
3.1×10²³ FLOPPublished paper
Training hardware
NVIDIA V100 clusters (Microsoft-built)Published paper
How this connects to the rest of the stack
This record's links at a glance — click a group to jump to it.
Developed by
Trained on
Training data includes
Introduced
Succeeded by
Successor to
Sources
Record reviewed as of 2026-01-15 — see Methodology.