Evaluation for advanced learners
455 resources · page 15 of 15
τ-Bench: Benchmarking AI agents for the real-world (Sierra)
Creator not supplied; see original source.
Sierra post introducing τ-bench, a benchmark of tool-using agents talking to simulated users, with the pass^k reliability metric.
SUPERB
Creator not supplied; see original source.
arXiv paper (2021) "SUPERB: Speech processing Universal PERformance Benchmark", introducing SUPERB, a benchmark of speech representations across many speech tasks.
SWE-Bench Pro Verified
Creator not supplied; see original source.
arXiv paper (2026) introducing SWE-Bench Pro Verified, an audited software-engineering benchmark that removes leakage and flawed tasks.
The Leaderboard Illusion
Creator not supplied; see original source.
arXiv paper (2025) "The Leaderboard Illusion", auditing how private testing and data access distort Chatbot Arena rankings.
Tutor CoPilot: a human-AI approach to real-time expertise
Creator not supplied; see original source.
arXiv paper (2024) reporting a randomized field study of Tutor CoPilot, an AI assistant for human tutors.
Inspect
by UK AI Security Institute and Meridian Labs
Compose evaluation datasets, agents, tools and scorers.
UNLP 2026 Ukrainian NLP workshop paper
Creator not supplied; see original source.
UNLP 2026 workshop paper (PDF) on Ukrainian NLP evaluation.