Evaluation & benchmarks for advanced learners
452 resources · page 15 of 15
SWE-Bench Pro Verified
by Pujun Zheng et al. (Shanghai Artificial Intelligence Laboratory)
arXiv paper (2026) introducing SWE-Bench Pro Verified, an audited software-engineering benchmark that removes leakage and flawed tasks.
The Leaderboard Illusion
by Shivalika Singh et al. (Cohere)
arXiv paper (2025) "The Leaderboard Illusion", auditing how private testing and data access distort Chatbot Arena rankings.
Tutor CoPilot: a human-AI approach to real-time expertise
by Rose E. Wang et al. (Stanford University)
arXiv paper (2024) reporting a randomized field study of Tutor CoPilot, an AI assistant for human tutors.
UNLP 2026 Ukrainian NLP workshop paper
UNLP 2026 workshop paper (PDF) on Ukrainian NLP evaluation.