Synthetic Data & the Data Wall
概念
训练与推理
When the internet runs out, models train on model output.
您正在查看一条概念解释记录：该术语的通俗含义，以及它所关联的各条目。
Frontier labs have essentially consumed the high-quality public web — the 'data wall.' The response is synthetic data: stronger models generating curricula for the next generation (Phi's textbooks, reasoning traces for RL). Done carelessly it degrades models; done well it is now standard — and it shifts value from scraping toward licensed and generated corpora.
它如何与整个技术栈相连
本记录的关联链接一览——点击分组可直接跳转。
来源
记录审阅截至 2026-01-15 — 查看 方法论.