lm-evaluation-harness
by EleutherAI
Run model benchmarks through reusable task and backend interfaces.
EleutherAI's harness brings evaluation tasks, model adapters and scoring configuration into a common framework. It helps make comparisons repeatable, while leaving dataset suitability and experimental controls to the evaluator.
- Level
- Advanced
- Models
- any
- Category
- Evaluation
- Tags
- Source date
- date not stated
- Added
- 2026-10-18
- Last verified
- 2026-10-18
- Status
- ok
- Prerequisites
- Requires implementation experience or critical reading of technical methods and system trade-offs.
- Subcategory
- eval harnesses
- Region
- West
- Original language
- en
- Access
- free
- Resource reuse
- open: Source states MIT. Applies to the linked resource, not every referenced model or dataset. Facet definitions
Summary in our own words. Rights remain with the original creator. Credit and correction policy.