Eval Harnesses: 3 curated resources

Curated material on eval harnesses within evaluation.

3 resources · page 1 of 1

• lm-evaluation-harness

  by EleutherAI

  Run model benchmarks through reusable task and backend interfaces.

  Advanced · West · open resource · en

• simple-evals

  by OpenAI

  Read reference evaluation code with an explicit maintenance caveat.

  Advanced stale · West · open resource · en

• Inspect

  by UK AI Security Institute and Meridian Labs

  Compose evaluation datasets, agents, tools and scorers.

  Advanced · West · closed resource · en

Plain-text Markdown copy