数据库分类 · 12 记录
基准测试
How capability and hardware are actually measured — and which yardsticks are already saturated.
现场笔记
基准测试是这个行业的计分方式，其生命周期始终如一：发布、被攻克、退场。每条记录真正值得关注的，不是当前的领先者，而是这项测试从"不可能"到"饱和"用了多长时间。
从这三个开始
ML
MLPerf
AI硬件领域唯一经过审计的同类对比数据。
SB
SWE-bench Verified
真实的GitHub issue——智能体编码时代的标尺。
AA
ARC-AGI
专为抵抗记忆而生，却还是被攻破。之后以更强的方式重建。
Hardware & systems benchmarks
2
ML
MLPerf
The industry's referee for AI hardware — training and inference rounds.
TO
TOP500
The supercomputer league table since 1993 — now measuring the public sector's slice.
Model capability benchmarks
10
SB
SWE-bench Verified
Real GitHub issues, real repos — the coding-agent standard.
A(
AIME (Competition Math)
Olympiad-track problems — where reasoning models showed their jump.
AA
ARC-AGI
Chollet's abstraction puzzles — designed to resist everything but intelligence.
FR
FrontierMath
Research-grade mathematics — built unsolvable, already yielding.
GD
GPQA Diamond
Google-proof PhD science questions — the reasoning era's exam.
H&
HumanEval & GSM8K
The retired classics of coding and grade-school math.
HL
Humanity's Last Exam
2,500 expert questions with a deliberately final name.
L(
LMArena (Chatbot Arena)
Millions of blind human votes — preference as a leaderboard.
M&
MMLU & MMLU-Pro
The default knowledge exam of 2020–24 — now saturated.
MT
MTEB
The embedding leaderboard behind every retrieval stack.