Home › Research Papers › Attention Is All You Need (2017)
Attention Is All You Need (2017)
Research Paper
Architecture
The eight Google authors who invented the transformer.
You're looking at a research-paper record: a landmark paper and what it introduced to the field.
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser and Polosukhin replaced recurrence entirely with self-attention, making sequence models parallelizable — and therefore scalable on GPUs. Cited hundreds of thousands of times, it is the single most consequential paper in this database: GPT, Claude, Gemini, Llama and nearly everything else instantiate it. All eight authors left Google, mostly to found companies (Cohere, Character.AI, Adept, Essential AI, Sakana).
How this connects to the rest of the stack
This record's links at a glance — click a group to jump to it.
Authored by
Introduced in
Basis for
Sources
Record reviewed as of 2026-01-15 — see Methodology.