GPT-2 ☆

GPT-2 (1.5B parameters) showed that scaling up next-token prediction produced coherent multi-paragraph text. OpenAI's staged release, citing misuse fears, started the norm-setting debate about publishing powerful models that has shaped the field since. Fully open-sourced by the end of 2019.