Parameters
The learned numbers — and why 'bigger' stopped being the whole story.
Anda sedang melihat entri penjelas konsep: apa arti istilah ini dalam bahasa yang mudah dipahami, dan entri-entri yang dikaitkannya.
Parameters are the weights a model learns; storing and moving them is what all the memory on this site is for (a 405B-parameter model needs ~800 GB at 16-bit). Counts climbed from GPT-2's 1.5B to trillion-parameter mixtures, but since Chinchilla the field optimizes parameters against data and compute jointly — and closed labs stopped disclosing counts at all, which is why so many records here say 'not publicly disclosed.'
Bagaimana ini terhubung ke bagian lain dari stack
Tautan catatan ini sekilas — klik grup untuk langsung menuju ke sana.
Terkait
Sumber
Rekaman ditinjau per 2026-01-15 — lihat Metodologi.