--- id: "/evaluation-benchmarks/expert/page/14/" title: "Evaluation & benchmarks for expert learners · page 14" url: "https://skillissue.dev/evaluation-benchmarks/expert/page/14/" --- # Evaluation & benchmarks for expert learners [Beginner](/evaluation-benchmarks/beginner/index.md) [Intermediate](/evaluation-benchmarks/intermediate/index.md) [Advanced](/evaluation-benchmarks/advanced/index.md) [Expert](/evaluation-benchmarks/expert/index.md) 443 resources · page 14 of 14 - ### [CLARIN-PT-LDB paper](/evaluation/benchmarks-and-leaderboards/clarin-pt-ldb-paper/index.md) by [João Silva et al. (University of Lisbon)](https://www.ulisboa.pt) arXiv paper (2026) introducing CLARIN-PT-LDB, an open LLM leaderboard for European Portuguese. Advanced–Expert learning_resource paper Portugal pt - ### [FlagEval Findings Report (LRMs)](/evaluation/benchmarks-and-leaderboards/flageval-findings-report-lrms/index.md) by [Bowen Qin et al. (BAAI)](https://www.baai.ac.cn/) arXiv paper (2025) FlagEval findings report: BAAI's preliminary evaluation of large reasoning models. Advanced–Expert learning_resource paper China en - ### [FlagEvalMM](/evaluation/benchmarks-and-leaderboards/flagevalmm/index.md) by [Zheqi He et al. (BAAI)](https://www.baai.ac.cn/) arXiv paper (2025) introducing FlagEvalMM, BAAI's framework for evaluating multimodal models. Advanced–Expert learning_resource paper China en - ### [Inspect India Evals](/evaluation/benchmarks-and-leaderboards/inspect-india-evals/index.md) by [Abhishek Kumar Singh et al.](https://openalex.org/authors/A5143884522) arXiv paper (2026) introducing Inspect India Evals, an open framework of Indian benchmarks with a fairness index. Advanced–Expert learning_resource paper India mul - ### [J-AISI annual report 2025](/evaluation/benchmarks-and-leaderboards/j-aisi-annual-report-2025/index.md) by [Japan AI Safety Institute](https://aisi.go.jp/) Japan AI Safety Institute 2025 annual activity report (PDF, Japanese). Advanced–Expert learning_resource paper Japan ja - ### [Korea AISI 5th AI Safety Forecast Report](/evaluation/benchmarks-and-leaderboards/korea-aisi-5th-ai-safety-forecast-report-2026-09-03/index.md) by [Korea AISI](https://aisi.re.kr/) Korea AI Safety Institute 5th AI Safety Forecast Report covering May–July 2026. Advanced–Expert learning_resource paper Korea ko - ### [La Leaderboard paper](/evaluation/benchmarks-and-leaderboards/la-leaderboard-paper/index.md) by [María Grandury et al. (Universidad Politécnica de Madrid)](https://www.upm.es) arXiv paper (2025) introducing La Leaderboard, an LLM leaderboard for Spanish varieties and languages of Spain and Latin America. Advanced–Expert learning_resource paper Spain/LatAm es|ca|eu|gl - ### [Open Ko-LLM Leaderboard2 paper](/evaluation/benchmarks-and-leaderboards/open-ko-llm-leaderboard2-paper/index.md) by [Hyeonwoo Kim et al. (Upstage)](https://www.upstage.ai) arXiv paper (2024) describing Open Ko-LLM Leaderboard2 for evaluating Korean LLMs. Advanced–Expert learning_resource paper Korea ko|en - ### [SEA-HELM paper](/evaluation/benchmarks-and-leaderboards/sea-helm-paper/index.md) by [Yosephine Susanto et al. (AI Singapore)](https://aisingapore.org/) arXiv paper (2025) introducing SEA-HELM, holistic evaluation of language models on Southeast Asian languages. Advanced–Expert learning_resource paper SE Asia en - ### [UNLP 2026 Ukrainian NLP workshop paper](/evaluation/benchmarks-and-leaderboards/unlp-2026-ukrainian-nlp-workshop-paper/index.md) by [Svitlana Galeshchuk et al.](https://aclanthology.org/people/svitlana-galeshchuk/unverified/) UNLP 2026 workshop paper (PDF) on Ukrainian NLP evaluation. Advanced–Expert learning_resource paper Ukraine uk|en - ### [3D Arena paper](/evaluation/benchmarks-and-leaderboards/3d-arena-paper/index.md) by [Dylan Ebert (Hugging Face)](https://huggingface.co/) arXiv paper (2025) introducing 3D Arena, an open pairwise-preference platform for evaluating generative 3D models. Expert learning_resource paper US/France (HF) en - ### [BEHAVIOR 2025 1st-place report](/evaluation/benchmarks-and-leaderboards/behavior-2025-1st-place-report/index.md) by [Ilia Larchenko, Gleb Zarin and Akash Karnatak](https://ilialarchenko.com/) arXiv PDF (2025) of the first-place report from the NeurIPS 2025 BEHAVIOR household robotics challenge. Expert learning_resource paper unstated en - ### [A framework for evaluating the chemical knowledge and reasoning abilities of large language models (ChemBench)](/evaluation/benchmarks-and-leaderboards/chembench-paper-nature-chemistry-2025/index.md) by [Adrian Mirza et al. (Helmholtz Institute Jena)](https://www.hi-jena.de) ChemBench paper (Nature Chemistry 2025, PMC full text): framework evaluating chemical knowledge and reasoning of LLMs against chemists. Expert learning_resource paper Germany en - ### [EvalScope τ-bench docs (ModelScope/Alibaba)](/evaluation/benchmarks-and-leaderboards/evalscope-bench-docs-modelscope-alibaba/index.md) by [ModelScope (Alibaba)](https://www.modelscope.cn/) EvalScope documentation on τ-bench: running the conversational agent benchmark with Alibaba's ModelScope evaluation framework. Expert learning_resource docs China en|zh - ### [FinanceBench: A New Benchmark for Financial Question Answering](/evaluation/benchmarks-and-leaderboards/financebench-paper-arxiv-2311-11944/index.md) by [Pranab Islam et al. (Stanford University)](https://www.stanford.edu) arXiv paper (2023) introducing FinanceBench, a benchmark for financial question answering over company filings. Expert learning_resource paper US en - ### [FrontierMath paper](/evaluation/benchmarks-and-leaderboards/frontiermath-paper/index.md) by [Elliot Glazer et al. (Rutgers, The State University of New Jersey)](https://www.rutgers.edu/) arXiv paper (2024) introducing FrontierMath, a benchmark of unpublished advanced mathematics problems. Expert learning_resource paper US en - ### [MASK paper](/evaluation/benchmarks-and-leaderboards/mask-paper/index.md) by [Richard Ren et al. (Center for AI Safety)](https://safe.ai/) arXiv PDF (2025) of the MASK benchmark paper on measuring honesty separately from accuracy in LLMs. Expert learning_resource paper US en - ### [Medical VLM contamination audit](/evaluation/benchmarks-and-leaderboards/medical-vlm-contamination-audit/index.md) by [Bruce Changlong Xu et al. (Stanford University)](https://www.stanford.edu) arXiv paper (2026) auditing pretraining contamination of public medical vision-language benchmarks. Expert learning_resource paper unstated en - ### [MMMU-Pro paper](/evaluation/benchmarks-and-leaderboards/mmmu-pro-paper/index.md) by [Xiang Yue et al. (Carnegie Mellon University)](https://www.cmu.edu/) arXiv HTML version of the MMMU-Pro paper (2024), a harder multimodal multi-discipline benchmark. Expert learning_resource paper US en - ### [Music Arena paper](/evaluation/benchmarks-and-leaderboards/music-arena-paper/index.md) by [Yonghyun Kim et al. (Carnegie Mellon University, LMArena and Sony AI)](https://www.cmu.edu/) arXiv paper (2025) introducing Music Arena, live human-preference evaluation for text-to-music models. Expert learning_resource paper US/Japan (CMU and Sony listed in search) en - ### [Open ASR Leaderboard paper](/evaluation/benchmarks-and-leaderboards/open-asr-leaderboard-paper/index.md) by [Vaibhav Srivastav et al. (Hugging Face)](https://huggingface.co/) arXiv PDF (2025) of the Open ASR Leaderboard paper: evaluation method, datasets and results for speech recognition models. Expert learning_resource paper France/UK en - ### [RoboArena paper page (Penn)](/evaluation/benchmarks-and-leaderboards/roboarena-paper-page-penn/index.md) by [University of Pennsylvania](https://www.upenn.edu/) RoboArena paper page (University of Pennsylvania): distributed real-world evaluation of generalist robot policies. Expert learning_resource paper US en - ### [Frontier AI Risk Management Framework in Practice (Shanghai AI Lab)](/evaluation/benchmarks-and-leaderboards/shanghai-ai-lab-frontier-ai-risk-management-framework-technical-report/index.md) by [Shanghai AI Lab (Shanghai AI Laboratory)](https://www.shlab.org.cn/) arXiv paper (2025) by Shanghai AI Laboratory applying its Frontier AI Risk Management Framework to analyse model risks. Expert learning_resource paper China [STATE] en - ### [TaxPraBen: Chinese real-world tax practice](/evaluation/benchmarks-and-leaderboards/taxpraben-chinese-real-world-tax-practice/index.md) by [Gang Hu et al.](https://aclanthology.org/people/gang-hu/) ACL 2026 paper introducing TaxPraBen, a benchmark of LLMs on Chinese real-world tax practice tasks. Expert learning_resource paper China en - ### [VBench-2.0 paper](/evaluation/benchmarks-and-leaderboards/vbench-2-0-paper/index.md) by [Dian Zheng et al. (Nanyang Technological University and Shanghai AI Laboratory)](https://www.ntu.edu.sg/) arXiv HTML version of the VBench-2.0 paper (2025) evaluating video generation on physics, commonsense and faithfulness. Expert learning_resource paper Singapore/China en - ### [When Rubrics Fail](/evaluation/benchmarks-and-leaderboards/when-rubrics-fail-medical-eval-hallucination/index.md) by [Griffin Farrow et al. (University of Oxford)](https://www.ox.ac.uk/) arXiv PDF (2026) "When Rubrics Fail", a critique of rubric-based evaluation in medical LLM benchmarks. Expert learning_resource paper unstated en - ### [Who Validates the Validators? (Shankar et al.)](/evaluation/benchmarks-and-leaderboards/who-validates-the-validators-shankar-et-al/index.md) by [Shreya Shankar et al. (UC Berkeley)](https://www.berkeley.edu/) arXiv paper (2024) by Shankar et al. on aligning LLM-assisted evaluators with human preferences and criteria drift. Expert learning_resource paper US en [Previous page](/evaluation-benchmarks/expert/page/13/index.md) [Plain-text Markdown copy](/evaluation-benchmarks/expert/page/14/index.md)