Tokens & Tokenization
概念
核心技术
The unit AI is bought, sold and measured in.
您正在查看一条概念解释记录：该术语的通俗含义，以及它所关联的各条目。
Models read and write tokens — word fragments, roughly ¾ of an English word each. Context windows, API prices, throughput benchmarks and 'tokens per second' hardware claims all count them. When executives describe data centers as 'token factories,' this is the commodity they mean: the entire economics of inference reduces to the cost of producing a token.
它如何与整个技术栈相连
本记录的关联链接一览——点击分组可直接跳转。
来源
记录审阅截至 2026-01-15 — 查看 方法论.