Các tài liệu gốc của sự kiện này
2-
Bài báo nghiên cứu
Attention Is All You Need (2017)
The eight Google authors who invented the transformer.
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser and Polosukhin replaced recurrence entirely with self-attention, making sequence models parallelizable, and therefore scalable on GPUs. Cited hundreds of thousands of times, it is the single most consequential paper in this database: GPT, Claude, Gemini, Llama and nearly everything else instantiate…
Mở hồ sơ → -
Khái niệm
Transformer
The 2017 architecture everything on this site exists to run.
The transformer processes every token in a sequence in parallel, using attention to let each token consult every other. That parallelism is why GPUs and transformers co-evolved: the architecture is essentially a giant matrix-multiplication workload, which is exactly what accelerator silicon does best. GPT, Claude, Gemini, Llama, image diffusion backbones…
Mở hồ sơ →