simple-evals
by OpenAI
Read reference evaluation code with an explicit maintenance caveat.
OpenAI's repository exposes implementations used for reported model measurements. The project says it stopped adding new model results in July 2025 while retaining reference implementations for selected benchmarks.
- Level
- Advanced
- Models
- any
- Category
- Evaluation
- Tags
- archived
- Source date
- date not stated
- Added
- 2026-10-18
- Last verified
- 2026-10-18
- Status
- stale
- Prerequisites
- Requires implementation experience or critical reading of technical methods and system trade-offs.
- Subcategory
- eval harnesses
- Region
- West
- Original language
- en
- Access
- free
- Resource reuse
- open: Source states MIT. Applies to the linked resource, not every referenced model or dataset. Facet definitions
Summary in our own words. Rights remain with the original creator. Credit and correction policy.