The Pile
数据集
精选语料库
EleutherAI's 825 GB of curated diversity — open-source pre-training's foundation.
您正在查看一条数据集记录：一个训练数据集合——其中包含什么，以及哪些模型从中学习。
The Pile (2020) mixed 22 sources — papers, code, books, forums — and showed curation quality mattered as much as scale. It trained the GPT-Neo/GPT-J lineage that kept open research alive, and its inclusion of the Books3 shadow-library became a defining copyright battleground.
它如何与整个技术栈相连
本记录的关联链接一览——点击分组可直接跳转。
相关
来源
记录审阅截至 2026-01-15 — 查看 方法论.