Los registros detrás de este evento
2-
Artículo de investigación
Attention Is All You Need (2017)
The eight Google authors who invented the transformer.
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser and Polosukhin replaced recurrence entirely with self-attention, making sequence models parallelizable, and therefore scalable on GPUs. Cited hundreds of thousands of times, it is the single most consequential paper in this database: GPT, Claude, Gemini, Llama and nearly everything else instantiate…
Abrir registro → -
Concepto
Transformer
The 2017 architecture everything on this site exists to run.
The transformer processes every token in a sequence in parallel, using attention to let each token consult every other. That parallelism is why GPUs and transformers co-evolved: the architecture is essentially a giant matrix-multiplication workload, which is exactly what accelerator silicon does best. GPT, Claude, Gemini, Llama, image diffusion backbones…
Abrir registro →