--- id: "/evaluation-benchmarks/page/14/" title: "Evaluation & benchmarks · page 14" url: "https://skillissue.dev/evaluation-benchmarks/page/14/" --- # Evaluation & benchmarks Evaluation & benchmarks - [agent & coding evals](/evaluation-benchmarks/agent-coding-evals/index.md) (85) - [autonomous driving](/evaluation-benchmarks/autonomous-driving/index.md) (1) - [general leaderboards](/evaluation-benchmarks/general-leaderboards/index.md) (248) - [modality evals (image/video/speech)](/evaluation-benchmarks/modality-evals-image-video-speech/index.md) (87) - [physics & simulation](/evaluation-benchmarks/physics-simulation/index.md) (1) - [safety & efficiency evals](/evaluation-benchmarks/safety-efficiency-evals/index.md) (44) - [safety evals](/evaluation-benchmarks/safety-evals/index.md) (1) - [science & domain evals](/evaluation-benchmarks/science-domain-evals/index.md) (45) - [vision](/evaluation-benchmarks/vision/index.md) (1) [Beginner](/evaluation-benchmarks/beginner/index.md) [Intermediate](/evaluation-benchmarks/intermediate/index.md) [Advanced](/evaluation-benchmarks/advanced/index.md) [Expert](/evaluation-benchmarks/expert/index.md) 513 resources · page 14 of 17 - ### [Langfuse joins ClickHouse](/evaluation/benchmarks-and-leaderboards/langfuse-joining-clickhouse/index.md) by [Langfuse](https://langfuse.com/) Langfuse post announcing the company joined ClickHouse and describing plans for the open-source project. Beginner learning_resource blog Germany/EU en - ### [Latent Space: SWE-bench dead](/evaluation/benchmarks-and-leaderboards/latent-space-swe-bench-dead/index.md) by [Latent Space](https://www.latent.space/) Latent Space episode with OpenAI's Mia Glaese and Olivia Watkins on retiring SWE-bench Verified and next frontier evals. Beginner learning_resource podcast-video US en - ### [MMLU (classic)](/evaluation/benchmarks-and-leaderboards/mmlu-classic/index.md) by [Dan Hendrycks et al. (University of Chicago)](https://www.uchicago.edu) arXiv paper (2020) "Measuring Massive Multitask Language Understanding", introducing MMLU, a 57-subject multitask knowledge benchmark. Beginner learning_resource paper US en - ### [BEHAVIOR Challenge Charts the Way Forward for Domestic Robotics (Stanford HAI)](/evaluation/benchmarks-and-leaderboards/stanford-hai-behavior-challenge-article/index.md) by [Stanford HAI](https://hai.stanford.edu/) Stanford HAI article on the BEHAVIOR Challenge, a household-robotics competition in simulation held at NeurIPS 2025. Beginner learning_resource guide US en - ### [AI Agents That Matter](/evaluation/benchmarks-and-leaderboards/ai-agents-that-matter/index.md) by [Sayash Kapoor et al. (Princeton University)](https://www.princeton.edu/) arXiv paper (2024) "AI Agents That Matter", on cost-aware and reproducible evaluation of AI agents. Intermediate learning_resource paper US (Princeton) en - ### [March 2026: Arena Updates](/evaluation/benchmarks-and-leaderboards/arena-march-2026-updates-blog/index.md) by [Arena (formerly LMArena)](https://arena.ai/) Arena blog post on March 2026 updates: new document and video-edit arenas and leaderboard changes. Intermediate learning_resource docs US en - ### [Arize Phoenix docs: LLM-as-a-judge](/evaluation/benchmarks-and-leaderboards/arize-phoenix-llm-as-a-judge/index.md) by [Arize AI](https://www.arize.com) Arize Phoenix documentation on LLM-as-a-judge evaluation: designing judge prompts and criteria. Intermediate learning_resource docs US en - ### [Berget AI: AI in Swedish](/evaluation/benchmarks-and-leaderboards/berget-ai-ai-in-swedish/index.md) by [Berget AI](https://berget.ai/) Berget AI post on choosing models for Swedish-language applications, pointing to EuroEval and Scandinavian embedding benchmarks. Intermediate learning_resource blog Sweden sv|en - ### [Braintrust documentation](/evaluation/benchmarks-and-leaderboards/braintrust-documentation/index.md) by [Braintrust](https://braintrust.dev/) Braintrust documentation for running experiments, scoring outputs and collecting production feedback on AI apps. Intermediate learning_resource docs US en - ### [Braintrust docs: Evaluate systematically](/evaluation/benchmarks-and-leaderboards/braintrust-evaluate/index.md) by [Braintrust](https://braintrust.dev/) Braintrust documentation on systematic evaluation: datasets, scorers and regression detection for AI applications. Intermediate learning_resource docs US en - ### [Can We Trust AI Benchmarks?](/evaluation/benchmarks-and-leaderboards/can-we-trust-ai-benchmarks/index.md) by [Maria Eriksson et al. (European Commission)](https://commission.europa.eu) arXiv paper (2025) reviewing about 100 studies on the trustworthiness and limitations of AI benchmarks. Intermediate learning_resource paper EU (JRC) en - ### [Chatbot Arena paper](/evaluation/benchmarks-and-leaderboards/chatbot-arena-paper/index.md) by [Wei-Lin Chiang et al. (LMSYS, UC Berkeley)](https://lmsys.org/) arXiv paper (2024) describing Chatbot Arena, its crowdsourced pairwise voting and Bradley-Terry ranking method. Intermediate learning_resource paper US en - ### [How Some of China's Top AI Thinkers Built Their Own AI Safety Institute (Carnegie)](/evaluation/benchmarks-and-leaderboards/china-ai-safety-development-association-cnaisda-carnegie-analysis/index.md) by [Carnegie Endowment for International Peace](https://carnegieendowment.org/) Carnegie Endowment analysis of the China AI Safety and Development Association and its role in Chinese AI governance. Intermediate learning_resource blog China en - ### [Demystifying evals for AI agents](/evaluation/benchmarks-and-leaderboards/demystifying-evals-for-ai-agents/index.md) by [Anthropic](https://anthropic.com/) Anthropic post on designing evals for AI agents, combining automated tests, graders and human review. Intermediate learning_resource guide US en - ### [SimpleQA Verified: Benchmark review (Epoch AI)](/evaluation/benchmarks-and-leaderboards/epoch-benchmark-review-simpleqa-verified/index.md) by [Epoch AI](https://epoch.ai/) Epoch AI review of the SimpleQA Verified benchmark, checking a sample of questions for correctness. Intermediate learning_resource guide US en - ### [Evaluating the Effectiveness of LLM-Evaluators (Eugene Yan)](/evaluation/benchmarks-and-leaderboards/eugene-yan-llm-evaluators/index.md) by [Eugene Yan](https://eugeneyan.com/) Eugene Yan's review of LLM-evaluator (LLM-as-judge) research: use cases, techniques, alignment and critiques. Intermediate learning_resource guide US en - ### [GAIA paper](/evaluation/benchmarks-and-leaderboards/gaia-paper/index.md) by [Grégoire Mialon et al. (Meta AI and Hugging Face)](https://ai.meta.com/) arXiv paper (2023) introducing GAIA, a benchmark of real-world questions for general AI assistants. Intermediate learning_resource paper France/US en - ### [Announcing Agent Control (Galileo)](/evaluation/benchmarks-and-leaderboards/galileo-agent-control-open-source-control-plane/index.md) by [Galileo](https://galileo.ai/) Galileo post announcing Agent Control, an open-source control plane for runtime guardrails on AI agents. Intermediate learning_resource blog US en - ### [Launching Agent Leaderboard v2 (Galileo)](/evaluation/benchmarks-and-leaderboards/galileo-agent-leaderboard-v2/index.md) by [Galileo](https://galileo.ai/) Galileo post introducing Agent Leaderboard v2, which evaluates LLMs as enterprise customer-support agents. Intermediate learning_resource blog US en - ### [Best Practices to Navigate the Complexities of Evaluating AI Agents (Galileo)](/evaluation/benchmarks-and-leaderboards/galileo-best-practices-for-evaluating-ai-agents/index.md) by [Galileo](https://galileo.ai/) Galileo guide to evaluating AI agents, covering accuracy metrics, action evaluation and production monitoring. Intermediate learning_resource blog US en - ### [SberDevices blog on Habr](/evaluation/benchmarks-and-leaderboards/habr-sberdevices-blog/index.md) by [SberDevices](https://sberdevices.ru/) SberDevices company blog on Habr with Russian-language technical posts on GigaChat models and evaluation. Intermediate learning_resource blog Russia ru - ### [Using LLM-as-a-Judge For Evaluation: A Complete Guide (Hamel Husain)](/evaluation/benchmarks-and-leaderboards/hamel-llm-as-a-judge-guide/index.md) by [Hamel Husain](https://hamel.dev/) Hamel Husain's guide to building an LLM judge and validating it against domain-expert labels. Intermediate learning_resource guide US en - ### [HF blog: Hebrew leaderboard](/evaluation/benchmarks-and-leaderboards/hf-blog-hebrew-leaderboard/index.md) by [Hugging Face](https://huggingface.co/) Hugging Face blog source file announcing the Hebrew LLM leaderboard and its evaluation tasks. Intermediate learning_resource blog Israel en - ### [AI Evals: Everything You Need to Know (Hamel Husain)](/evaluation/benchmarks-and-leaderboards/husain-shankar-ai-evals-everything-you-need-to-know/index.md) by [Hamel Husain](https://hamel.dev/) Hamel Husain and Shreya Shankar's AI evals FAQ for engineers and PMs: testing AI systems, error analysis, RAG and agent evals. Intermediate learning_resource guide US en - ### [Announcing Evals and Releases for Fin (Intercom)](/evaluation/benchmarks-and-leaderboards/intercom-announcing-evals-and-releases-for-fin-2026-08-13/index.md) by [Intercom](https://www.intercom.com/) Intercom post announcing Evals and Releases for its Fin support agent, for testing before, during and after launch. Intermediate learning_resource blog IE/US en - ### [Judging LLM-as-a-Judge (MT-Bench)](/evaluation/benchmarks-and-leaderboards/judging-llm-as-a-judge-mt-bench/index.md) by [Lianmin Zheng et al. (LMSYS, UC Berkeley)](https://lmsys.org/) arXiv paper (2023) on using strong LLMs as judges, with MT-Bench, Chatbot Arena and analysis of judge biases. Intermediate learning_resource paper US en - ### [The Most Common Questions About Agent Evals, Answered (LangChain)](/evaluation/benchmarks-and-leaderboards/langchain-common-questions-about-agent-evals/index.md) by [LangChain](https://www.langchain.com/) LangChain post answering common questions on agent evals: offline vs online, evaluator types, LLM judges and multi-turn tests. Intermediate learning_resource blog US en - ### [Langfuse blog: Evaluating AI agent skills](/evaluation/benchmarks-and-leaderboards/langfuse-evaluating-ai-agent-skills-2026-02-26/index.md) by [Langfuse](https://langfuse.com) Langfuse blog post on how to evaluate AI agent skills (SKILL.md files) with traces and evals. Intermediate learning_resource blog Germany/EU en - ### [LangSmith docs: Evaluation concepts](/evaluation/benchmarks-and-leaderboards/langsmith-evaluation-concepts/index.md) by [LangChain](https://www.langchain.com) LangSmith documentation source on evaluation concepts: datasets, evaluators, offline and online evals. Intermediate learning_resource docs US en - ### [Legal Technology Insider: Vals report missing the market leaders](/evaluation/benchmarks-and-leaderboards/legal-technology-insider-vals-report-missing-the-market-leaders/index.md) by [Legal Technology Insider](https://legaltechnology.com/) Legal Technology Insider article on the Vals AI legal research benchmark report, noting which major vendors did not take part. Intermediate learning_resource blog UK en - ### [LiveBench paper](/evaluation/benchmarks-and-leaderboards/livebench-paper/index.md) by [Colin White et al. (Abacus.AI)](https://abacus.ai/) arXiv paper (2024) introducing LiveBench, a contamination-limited LLM benchmark with regularly refreshed questions. Intermediate learning_resource paper US en - ### [LiveCodeBench paper](/evaluation/benchmarks-and-leaderboards/livecodebench-paper/index.md) by [Naman Jain et al. (Cornell University)](https://www.cornell.edu) arXiv paper (2024) introducing LiveCodeBench, a contamination-free code benchmark built from recent contest problems. Intermediate learning_resource paper US en [Previous page](/evaluation-benchmarks/page/13/index.md) [Next page](/evaluation-benchmarks/page/15/index.md) [Plain-text Markdown copy](/evaluation-benchmarks/page/14/index.md)