---
id: "/evaluation/"
title: "Evaluation"
creator: null
creator_url: null
url: "https://skillissue.dev/evaluation/"
level: null
level_max: null
category: null
subcategory: null
region: null
license: null
license_scope: null
models: null
source_date: null
date_added: null
---

# Evaluation

Measure model capabilities and application behavior with explicit criteria.

- [Eval Harnesses](/evaluation/eval-harnesses/index.md) (3)

- [Application Evals](/evaluation/application-evals/index.md) (2)

- [Llm As Judge](/evaluation/llm-as-judge/index.md) (1)

- [Agent Evals](/evaluation/agent-evals/index.md) (1)

[Beginner](/evaluation/beginner/index.md) [Intermediate](/evaluation/intermediate/index.md) [Advanced](/evaluation/advanced/index.md) [Expert](/evaluation/expert/index.md)

7 resources · page 1 of 1

- 

### [AI Evals FAQ](/evaluation/application-evals/hamel-husain-ai-evals-faq/index.md)

by [Hamel Husain and Shreya Shankar](https://hamel.dev/blog/posts/evals-faq/)

Practical answers about error analysis, annotation and reliable evaluators.

Intermediate · West · closed resource · en

- 

### [Your AI Product Needs Evals](/evaluation/application-evals/hamel-husain-your-ai-product-needs-evals/index.md)

by [Hamel Husain](https://hamel.dev/blog/posts/evals/)

Build a feedback loop from real failures, not general benchmark scores.

Intermediate · West · closed resource · en

- 

### [SWE-bench Leaderboards](/evaluation/agent-evals/swe-bench-team-swe-bench-leaderboards/index.md)

by [SWE-bench team (Princeton/Stanford)](https://www.swebench.com/)

Understand coding-agent scores in terms of resolved repository tasks.

Intermediate · West · closed resource · en

- 

### [lm-evaluation-harness](/evaluation/eval-harnesses/eleutherai-lm-evaluation-harness/index.md)

by [EleutherAI](https://github.com/EleutherAI/lm-evaluation-harness)

Run model benchmarks through reusable task and backend interfaces.

Advanced · West · open resource · en

- 

### [Evaluating the Effectiveness of LLM-Evaluators (LLM-as-Judge)](/evaluation/llm-as-judge/eugene-yan-evaluating-the-effectiveness-of-llm-evaluators/index.md)

by [Eugene Yan](https://eugeneyan.com/writing/llm-evaluators/)

Compare model-based graders against the judgments they must approximate.

Advanced · West · closed resource · en

- 

### [simple-evals](/evaluation/eval-harnesses/openai-simple-evals/index.md)

by [OpenAI](https://github.com/openai/simple-evals)

Read reference evaluation code with an explicit maintenance caveat.

Advanced stale · West · open resource · en

- 

### [Inspect](/evaluation/eval-harnesses/uk-ai-security-institute-inspect/index.md)

by [UK AI Security Institute and Meridian Labs](https://inspect.aisi.org.uk/)

Compose evaluation datasets, agents, tools and scorers.

Advanced · West · closed resource · en

[Plain-text Markdown copy](/evaluation/index.md)