Evaluation
Measure model capabilities and application behavior with explicit criteria.
- Benchmarks And Leaderboards (512)
- Eval Harnesses (3)
- Application Evals (2)
- Llm As Judge (1)
- Agent Evals (1)
519 resources · page 17 of 17
Open ASR Leaderboard paper
Creator not supplied; see original source.
arXiv PDF (2025) of the Open ASR Leaderboard paper: evaluation method, datasets and results for speech recognition models.
RoboArena paper page (Penn)
Creator not supplied; see original source.
RoboArena paper page (University of Pennsylvania): distributed real-world evaluation of generalist robot policies.
Frontier AI Risk Management Framework in Practice (Shanghai AI Lab)
Creator not supplied; see original source.
arXiv paper (2025) by Shanghai AI Laboratory applying its Frontier AI Risk Management Framework to analyse model risks.
TaxPraBen: Chinese real-world tax practice
Creator not supplied; see original source.
ACL 2026 paper introducing TaxPraBen, a benchmark of LLMs on Chinese real-world tax practice tasks.
VBench-2.0 paper
Creator not supplied; see original source.
arXiv HTML version of the VBench-2.0 paper (2025) evaluating video generation on physics, commonsense and faithfulness.
When Rubrics Fail
Creator not supplied; see original source.
arXiv PDF (2026) "When Rubrics Fail", a critique of rubric-based evaluation in medical LLM benchmarks.
Who Validates the Validators? (Shankar et al.)
Creator not supplied; see original source.
arXiv paper (2024) by Shankar et al. on aligning LLM-assisted evaluators with human preferences and criteria drift.