Short-answer factual accuracy and hallucination resistance on fact-seeking questions.
May republish0 incidents recorded
Text equivalentSimpleQA Verified: best reproduced result 71.6 points. Remaining headroom has not been measured, so how much room is left is unknown — not zero.
Remaining headroom has not been measured. Unknown, not zero.
Contamination controls
independently run under a fixed harness
restricted problem content on the FrontierMath tiers
Licence
CC BY 4.0 Recorded as republishable, so its figures appear on this site.
Update cadence
Maintainer-run; models are added when Epoch evaluates them
Access path
CSV inside the Epoch benchmark data archive
Incident log
Each entry states what was found, by whom, and when. The kind describes the finding, not anybody’s conduct. An entry without a primary source and a date is not published here.
No incidents recorded in this register.That is a statement about what we have recorded, not a finding that none exist. We have not audited every benchmark, and an absence here is an absence of evidence.