--- id: "/evaluation/advanced/page/14/" title: "Evaluation for advanced learners · page 14" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/evaluation/advanced/page/14/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Evaluation for advanced learners [Beginner](/evaluation/beginner/index.md) [Intermediate](/evaluation/intermediate/index.md) [Advanced](/evaluation/advanced/index.md) [Expert](/evaluation/expert/index.md) 455 resources · page 14 of 15 - ### [Agentic Benchmark Checklist (ABC)](/evaluation/benchmarks-and-leaderboards/agentic-benchmark-checklist-abc/index.md) Creator not supplied; see original source. arXiv paper (2025) proposing the Agentic Benchmark Checklist, guidelines for building valid agentic benchmarks. Advanced · unknown · unknown resource · en - ### [ARC Prize 2025 Technical Report](/evaluation/benchmarks-and-leaderboards/arc-prize-2025-technical-report/index.md) Creator not supplied; see original source. arXiv paper (2026) ARC Prize 2025 technical report on ARC-AGI-2 results and winning approaches. Advanced · unknown · unknown resource · en - ### [Arize Phoenix docs: Evaluating multi-agent systems](/evaluation/benchmarks-and-leaderboards/arize-phoenix-evaluating-multi-agent-systems/index.md) Creator not supplied; see original source. Arize Phoenix documentation on evaluating multi-agent systems using traces of each agent's steps. Advanced · unknown · unknown resource · en - ### [Benchmark-based assessment of Indian foundation models](/evaluation/benchmarks-and-leaderboards/benchmark-based-assessment-of-indian-foundation-models/index.md) Creator not supplied; see original source. arXiv paper (2026) comparing publicly benchmarked Indian foundation models across benchmarks. Advanced–Expert · unknown · unknown resource · en - ### [C-Eval paper](/evaluation/benchmarks-and-leaderboards/c-eval-paper/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing C-Eval, a multi-level, multi-discipline Chinese evaluation suite for foundation models. Advanced–Expert · unknown · unknown resource · en - ### [CLARIN-PT-LDB paper](/evaluation/benchmarks-and-leaderboards/clarin-pt-ldb-paper/index.md) Creator not supplied; see original source. arXiv paper (2026) introducing CLARIN-PT-LDB, an open LLM leaderboard for European Portuguese. Advanced–Expert · unknown · unknown resource · pt - ### [Coding-agent leaderboard resolution audit](/evaluation/benchmarks-and-leaderboards/coding-agent-leaderboard-resolution-audit/index.md) Creator not supplied; see original source. arXiv paper (2026) arguing that coding agents have converged so the SWE-bench leaderboard can no longer separate them. Advanced · unknown · unknown resource · en - ### [Cross-Context Verification: Hierarchical Detection of Benchmark Contamination](/evaluation/benchmarks-and-leaderboards/cross-context-verification-contamination-detection/index.md) Creator not supplied; see original source. arXiv paper (2026) introducing Cross-Context Verification, a hierarchical method for detecting benchmark contamination. Advanced · unknown · unknown resource · en - ### [DuetBench (Decagon)](/evaluation/benchmarks-and-leaderboards/decagon-duetbench/index.md) Creator not supplied; see original source. Decagon post introducing DuetBench, a benchmark for self-improving customer-service agents. Advanced · unknown · unknown resource · en - ### [Evaluating the Effectiveness of LLM-Evaluators (LLM-as-Judge)](/evaluation/llm-as-judge/eugene-yan-evaluating-the-effectiveness-of-llm-evaluators/index.md) by [Eugene Yan](https://eugeneyan.com/writing/llm-evaluators/) [@eugeneyan](https://twitter.com/eugeneyan) Compare model-based graders against the judgments they must approximate. Advanced · West · closed resource · en - ### [Fairlearn](/evaluation/benchmarks-and-leaderboards/fairlearn/index.md) Creator not supplied; see original source. Fairlearn: open-source toolkit and guides for assessing and mitigating fairness issues in ML models. Advanced · unknown · unknown resource · en - ### [FlagEval Findings Report (LRMs)](/evaluation/benchmarks-and-leaderboards/flageval-findings-report-lrms/index.md) Creator not supplied; see original source. arXiv paper (2025) FlagEval findings report: BAAI's preliminary evaluation of large reasoning models. Advanced–Expert · unknown · unknown resource · en - ### [FlagEvalMM](/evaluation/benchmarks-and-leaderboards/flagevalmm/index.md) Creator not supplied; see original source. arXiv paper (2025) introducing FlagEvalMM, BAAI's framework for evaluating multimodal models. Advanced–Expert · unknown · unknown resource · en - ### [HAE-RAE Evaluation Toolkit / HRET](/evaluation/benchmarks-and-leaderboards/hae-rae-evaluation-toolkit-hret/index.md) Creator not supplied; see original source. arXiv paper (2025) introducing the HAE-RAE Evaluation Toolkit (HRET), a unified framework for evaluating Korean LLMs. Advanced · unknown · unknown resource · en - ### [HLE paper](/evaluation/benchmarks-and-leaderboards/hle-paper/index.md) Creator not supplied; see original source. arXiv paper (2025) introducing Humanity's Last Exam, a benchmark of expert-written questions across academic fields. Advanced · unknown · unknown resource · en - ### [IFEval](/evaluation/benchmarks-and-leaderboards/ifeval/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing IFEval, instruction-following evaluation with automatically verifiable instructions. Advanced · unknown · unknown resource · en - ### [Inspect India Evals](/evaluation/benchmarks-and-leaderboards/inspect-india-evals/index.md) Creator not supplied; see original source. arXiv paper (2026) introducing Inspect India Evals, an open framework of Indian benchmarks with a fairness index. Advanced–Expert · unknown · unknown resource · mul - ### [J-AISI annual report 2025](/evaluation/benchmarks-and-leaderboards/j-aisi-annual-report-2025/index.md) Creator not supplied; see original source. Japan AI Safety Institute 2025 annual activity report (PDF, Japanese). Advanced–Expert · unknown · unknown resource · ja - ### [Korea AISI 5th AI Safety Forecast Report](/evaluation/benchmarks-and-leaderboards/korea-aisi-5th-ai-safety-forecast-report-2026-09-03/index.md) Creator not supplied; see original source. Korea AI Safety Institute 5th AI Safety Forecast Report covering May–July 2026. Advanced–Expert · unknown · unknown resource · ko - ### [La Leaderboard paper](/evaluation/benchmarks-and-leaderboards/la-leaderboard-paper/index.md) Creator not supplied; see original source. arXiv paper (2025) introducing La Leaderboard, an LLM leaderboard for Spanish varieties and languages of Spain and Latin America. Advanced–Expert · unknown · unknown resource · es|ca|eu|gl - ### [LabSafety Bench](/evaluation/benchmarks-and-leaderboards/labsafety-bench/index.md) Creator not supplied; see original source. Nature Machine Intelligence paper introducing LabSafety Bench for LLM safety risks in scientific labs. Advanced · unknown · unknown resource · en - ### [METR experienced-developer productivity experiment](/evaluation/benchmarks-and-leaderboards/metr-experienced-developer-productivity-experiment/index.md) Creator not supplied; see original source. METR study of how early-2025 AI tools affected experienced open-source developers' productivity. Advanced · unknown · unknown resource · en - ### [MLflow documentation](/evaluation/benchmarks-and-leaderboards/mlflow-documentation/index.md) Creator not supplied; see original source. MLflow documentation: experiment tracking, model registry, GenAI tracing, evaluation and deployment. Advanced · unknown · unknown resource · en - ### [MME](/evaluation/benchmarks-and-leaderboards/mme/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing MME, a benchmark for perception and cognition in multimodal LLMs. Advanced · unknown · unknown resource · en - ### [Model Cards for Model Reporting](/evaluation/benchmarks-and-leaderboards/model-cards-for-model-reporting/index.md) Creator not supplied; see original source. Google Research publication page for Model Cards for Model Reporting, a standard for documenting trained models. Advanced · unknown · unknown resource · en - ### [MoleculeNet](/evaluation/benchmarks-and-leaderboards/moleculenet/index.md) Creator not supplied; see original source. arXiv paper (2017) "MoleculeNet: A Benchmark for Molecular Machine Learning", introducing the MoleculeNet benchmark datasets for molecular property prediction. Advanced · unknown · unknown resource · en - ### [Open Ko-LLM Leaderboard2 paper](/evaluation/benchmarks-and-leaderboards/open-ko-llm-leaderboard2-paper/index.md) Creator not supplied; see original source. arXiv paper (2024) describing Open Ko-LLM Leaderboard2 for evaluating Korean LLMs. Advanced–Expert · unknown · unknown resource · ko|en - ### [simple-evals](/evaluation/eval-harnesses/openai-simple-evals/index.md) by [OpenAI](https://github.com/openai/simple-evals) Read reference evaluation code with an explicit maintenance caveat. Advanced stale · West · open resource · en - ### [Introducing TRAIL: A Benchmark for Agentic Evaluation (Patronus AI)](/evaluation/benchmarks-and-leaderboards/patronus-trail-benchmark-for-agentic-evaluation-2025-06-05/index.md) Creator not supplied; see original source. Patronus AI post introducing TRAIL, a benchmark of annotated agent traces for detecting reasoning, planning and execution errors. Advanced · unknown · unknown resource · en - ### [Quantifying infrastructure noise in agentic coding evals](/evaluation/benchmarks-and-leaderboards/quantifying-infrastructure-noise-in-agentic-coding-evals/index.md) Creator not supplied; see original source. Anthropic engineering post quantifying how infrastructure noise affects agentic coding evaluation scores. Advanced · unknown · unknown resource · en - ### [Safetywashing](/evaluation/benchmarks-and-leaderboards/safetywashing/index.md) Creator not supplied; see original source. arXiv paper (2024) "Safetywashing", testing whether AI safety benchmarks measure safety or general capability. Advanced · unknown · unknown resource · en - ### [SEA-HELM paper](/evaluation/benchmarks-and-leaderboards/sea-helm-paper/index.md) Creator not supplied; see original source. arXiv paper (2025) introducing SEA-HELM, holistic evaluation of language models on Southeast Asian languages. Advanced–Expert · unknown · unknown resource · en [Previous page](/evaluation/advanced/page/13/index.md) [Next page](/evaluation/advanced/page/15/index.md) [Plain-text Markdown copy](/evaluation/advanced/page/14/index.md)