The records behind this event
2-
Research Paper
Attention Is All You Need (2017)
The eight Google authors who invented the transformer.
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser and Polosukhin replaced recurrence entirely with self-attention, making sequence models parallelizable, and therefore scalable on GPUs. Cited hundreds of thousands of times, it is the single most consequential paper in this database: GPT, Claude, Gemini, Llama and nearly everything else instantiate…
Open record → -
Concept
Transformer
The 2017 architecture everything on this site exists to run.
The transformer processes every token in a sequence in parallel, using attention to let each token consult every other. That parallelism is why GPUs and transformers co-evolved: the architecture is essentially a giant matrix-multiplication workload, which is exactly what accelerator silicon does best. GPT, Claude, Gemini, Llama, image diffusion backbones…
Open record →