Parameters
The learned numbers — and why 'bigger' stopped being the whole story.
Stai visualizzando una scheda concettuale: cosa significa questo termine in linguaggio chiaro, e i record che mette in relazione.
Parameters are the weights a model learns; storing and moving them is what all the memory on this site is for (a 405B-parameter model needs ~800 GB at 16-bit). Counts climbed from GPT-2's 1.5B to trillion-parameter mixtures, but since Chinchilla the field optimizes parameters against data and compute jointly — and closed labs stopped disclosing counts at all, which is why so many records here say 'not publicly disclosed.'
Come si collega al resto dello stack
I collegamenti di questa scheda a colpo d'occhio — clicca un gruppo per raggiungerlo.
Correlati
Fonti
Record revisionato al 2026-01-15 — vedi Metodologia.