{"data":{"slug":"humaneval","etype":"benchmark","name":"HumanEval & GSM8K","cat":"Capability","subtitle":"The retired classics of coding and grade-school math.","summary":"HumanEval (164 Python functions) and GSM8K (grade-school word problems) measured the 2021–24 climb from barely-working to near-perfect, then saturated — their history is the cleanest record of how fast base capability moved. Successors: LiveCodeBench, SWE-bench, AIME.","attrs":null,"kf":null,"aliases":["GSM8K"],"ticker":null,"exchange":null,"hq":null,"founded":null,"website":null,"status":null,"region":null,"asof":"2026-01-15","sources":[{"url":"https://arxiv.org/abs/2107.03374","label":"HumanEval paper"}]},"meta":{"found":true,"count":1,"served_from":"site cache (no live upstream calls)","as_of":"2026-10-14T06:34:19+00:00","disclaimer":"Research and information only — not investment advice. Structured records carry basis labels (vendor spec / reported / estimate); market quotes are delayed/indicative.","attribution":"Records compiled from vendor documentation, official filings and reputable public reporting; market quotes via financial data providers. See /data-sources."}}