Attention Is All You Need (2017)
研究论文
架构突破
The eight Google authors who invented the transformer.
您正在查看一条研究论文记录：一篇里程碑式的论文，以及它为该领域带来了什么。
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser and Polosukhin replaced recurrence entirely with self-attention, making sequence models parallelizable — and therefore scalable on GPUs. Cited hundreds of thousands of times, it is the single most consequential paper in this database: GPT, Claude, Gemini, Llama and nearly everything else instantiate it. All eight authors left Google, mostly to found companies (Cohere, Character.AI, Adept, Essential AI, Sakana).
它如何与整个技术栈相连
本记录的关联链接一览——点击分组可直接跳转。
推出于
基础来源
来源
记录审阅截至 2026-01-15 — 查看 方法论.