InstructGPT — RLHF at Scale (2022) ☆

OpenAI showed that a 1.3B model tuned with human feedback was preferred over the raw 175B GPT-3 — alignment as capability. The three-stage recipe (demonstrations, reward model, RL) became the industry standard and made ChatGPT possible months later.