Home › Research Papers › Scaling Laws for Neural Language Models (2020)
Scaling Laws for Neural Language Models (2020)
Research Paper
Scaling
Kaplan et al.: loss falls as a power law in compute — the investment thesis, quantified.
You're looking at a research-paper record: a landmark paper and what it introduced to the field.
This OpenAI paper measured smooth power-law relationships between model performance and parameters, data and compute — the curves that turned 'bigger is better' from folklore into planning tool, and ultimately into capex justification for everything on this site.
How this connects to the rest of the stack
This record's links at a glance — click a group to jump to it.
Introduced in
Basis for
Sources
Record reviewed as of 2026-01-15 — see Methodology.