Databasesectie · 12 records
Benchmarks
How capability and hardware are actually measured — and which yardsticks are already saturated.
Veldnotities
Benchmarks zijn hoe deze industrie de score bijhoudt, en hun levenscyclus is altijd hetzelfde: geïntroduceerd, overwonnen, gepensioneerd. De interessante vraag bij elk record is niet de huidige leider — het is hoe snel de test ging van onmogelijk naar verzadigd.
Begin met deze drie
ML
MLPerf
De enige geauditeerde appels-met-appels-cijfers in AI-hardware.
SB
SWE-bench Verified
Echte GitHub-issues — de maatstaf van het coding-agent-tijdperk.
AA
ARC-AGI
Gebouwd om memorisatie te weerstaan; toch doorbroken. Daarna opnieuw gebouwd, robuuster.
Hardware & systems benchmarks
2
ML
MLPerf
The industry's referee for AI hardware — training and inference rounds.
TO
TOP500
The supercomputer league table since 1993 — now measuring the public sector's slice.
Model capability benchmarks
10
SB
SWE-bench Verified
Real GitHub issues, real repos — the coding-agent standard.
A(
AIME (Competition Math)
Olympiad-track problems — where reasoning models showed their jump.
AA
ARC-AGI
Chollet's abstraction puzzles — designed to resist everything but intelligence.
FR
FrontierMath
Research-grade mathematics — built unsolvable, already yielding.
GD
GPQA Diamond
Google-proof PhD science questions — the reasoning era's exam.
H&
HumanEval & GSM8K
The retired classics of coding and grade-school math.
HL
Humanity's Last Exam
2,500 expert questions with a deliberately final name.
L(
LMArena (Chatbot Arena)
Millions of blind human votes — preference as a leaderboard.
M&
MMLU & MMLU-Pro
The default knowledge exam of 2020–24 — now saturated.
MT
MTEB
The embedding leaderboard behind every retrieval stack.