--- id: "/evaluation/page/7/" title: "Evaluation · page 7" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/evaluation/page/7/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Evaluation Measure model capabilities and application behavior with explicit criteria. - [Benchmarks And Leaderboards](/evaluation/benchmarks-and-leaderboards/index.md) (512) - [Eval Harnesses](/evaluation/eval-harnesses/index.md) (3) - [Application Evals](/evaluation/application-evals/index.md) (2) - [Llm As Judge](/evaluation/llm-as-judge/index.md) (1) - [Agent Evals](/evaluation/agent-evals/index.md) (1) [Beginner](/evaluation/beginner/index.md) [Intermediate](/evaluation/intermediate/index.md) [Advanced](/evaluation/advanced/index.md) [Expert](/evaluation/expert/index.md) 519 resources · page 7 of 17 - ### [LIBERO-Plus](/evaluation/benchmarks-and-leaderboards/libero-plus/index.md) Creator not supplied; see original source. LIBERO-Plus paper: a robustness analysis of vision-language-action models using systematically perturbed LIBERO manipulation tasks. Not applicable (entity) · unknown · unknown resource · en - ### [LIBERO-PRO](/evaluation/benchmarks-and-leaderboards/libero-pro/index.md) Creator not supplied; see original source. LIBERO-PRO paper testing vision-language-action models under perturbed objects, instructions and environments to check if LIBERO scores generalise. Not applicable (entity) · unknown · unknown resource · en - ### [LiveBench](/evaluation/benchmarks-and-leaderboards/livebench/index.md) Creator not supplied; see original source. LiveBench 2.0: regularly refreshed, contamination-limited benchmark of long-horizon real-work tasks. Not applicable (entity) · unknown · unknown resource · en - ### [LiveCodeBench](/evaluation/benchmarks-and-leaderboards/livecodebench/index.md) Creator not supplied; see original source. LiveCodeBench leaderboard: code generation results on problems collected from recent programming contests. Not applicable (entity) · unknown · unknown resource · en - ### [LiveMedBench](/evaluation/benchmarks-and-leaderboards/livemedbench/index.md) Creator not supplied; see original source. LiveMedBench paper page: a continuously refreshed medical LLM benchmark built from real clinical cases with automated rubric scoring. Not applicable (entity) · unknown · unknown resource · en - ### [LLM-jp Eval](/evaluation/benchmarks-and-leaderboards/llm-jp-eval/index.md) Creator not supplied; see original source. llm-jp-eval GitHub repo: tool for automatically evaluating Japanese LLMs across multiple datasets. Not applicable (entity) · unknown · unknown resource · ja - ### [Arena text-to-image leaderboard](/evaluation/benchmarks-and-leaderboards/lmarena-text-to-image/index.md) Creator not supplied; see original source. Arena (formerly LMArena) text-to-image leaderboard: human-preference rankings of image generation models. Not applicable (entity) · unknown · unknown resource · en - ### [Arena text-to-video leaderboard](/evaluation/benchmarks-and-leaderboards/lmarena-text-to-video/index.md) Creator not supplied; see original source. Arena (formerly LMArena) text-to-video leaderboard: human-preference rankings of video generation models. Not applicable (entity) · unknown · unknown resource · en - ### [Arena Leaderboard (formerly LMArena)](/evaluation/benchmarks-and-leaderboards/lmarena-text-webdev-vision-text-to-image-video-search-arenas/index.md) Creator not supplied; see original source. Arena (formerly LMArena) leaderboards: human-preference rankings across text, webdev, vision, image, video and search arenas. Not applicable (entity) · unknown · unknown resource · en - ### [LMMS-Eval](/evaluation/benchmarks-and-leaderboards/lmms-eval/index.md) Creator not supplied; see original source. LMMS-Eval GitHub repo: evaluation toolkit for multimodal models across text, image, video and audio tasks. Not applicable (entity) · unknown · unknown resource · en - ### [LongBench](/evaluation/benchmarks-and-leaderboards/longbench/index.md) Creator not supplied; see original source. LongBench GitHub repo from THUDM: bilingual long-context benchmarks LongBench v1 and v2 with datasets and evaluation code. Not applicable (entity) · unknown · unknown resource · zh - ### [Probing the limitations of multimodal language models for chemistry and materials research (MaCBench)](/evaluation/benchmarks-and-leaderboards/macbench-multimodal-chemistry-materials/index.md) Creator not supplied; see original source. MaCBench paper probing multimodal language models on chemistry and materials-science tasks such as reading spectra and lab images. Not applicable (entity) · unknown · unknown resource · en - ### [ManiSkill](/evaluation/benchmarks-and-leaderboards/maniskill/index.md) Creator not supplied; see original source. ManiSkill site: GPU-accelerated simulation environments for training and evaluating robot manipulation policies at scale. Not applicable (entity) · unknown · unknown resource · en - ### [MASK (Scale Labs leaderboard)](/evaluation/benchmarks-and-leaderboards/mask-scale-labs-leaderboard/index.md) Creator not supplied; see original source. Scale Labs MASK leaderboard: benchmark by Scale AI and CAIS measuring honesty separately from accuracy. Not applicable (entity) · unknown · unknown resource · en - ### [Matbench](/evaluation/benchmarks-and-leaderboards/matbench/index.md) Creator not supplied; see original source. Materials Project Matbench GitHub repo: benchmark tasks for materials property prediction. Not applicable (entity) · unknown · unknown resource · en - ### [Matbench Discovery](/evaluation/benchmarks-and-leaderboards/matbench-discovery/index.md) Creator not supplied; see original source. Matbench Discovery GitHub repo: evaluation framework for ML models in materials stability discovery. Not applicable (entity) · unknown · unknown resource · en - ### [MATH](/evaluation/benchmarks-and-leaderboards/math/index.md) Creator not supplied; see original source. MATH dataset GitHub repo: competition mathematics problems with step-by-step solutions for evaluating reasoning. Not applicable (entity) · unknown · unknown resource · en - ### [MathArena](/evaluation/benchmarks-and-leaderboards/matharena/index.md) Creator not supplied; see original source. MathArena: evaluation of LLMs on newly released math competitions and arXiv-derived problems to avoid contamination. Not applicable (entity) · unknown · unknown resource · en - ### [MathVision](/evaluation/benchmarks-and-leaderboards/mathvision/index.md) Creator not supplied; see original source. MATH-Vision project page: competition math problems with visual contexts for evaluating multimodal reasoning. Not applicable (entity) · unknown · unknown resource · en - ### [MathVista](/evaluation/benchmarks-and-leaderboards/mathvista/index.md) Creator not supplied; see original source. MathVista project page: benchmark of math reasoning in visual contexts such as charts, diagrams and figures. Not applicable (entity) · unknown · unknown resource · en - ### [MedBench](/evaluation/benchmarks-and-leaderboards/medbench/index.md) Creator not supplied; see original source. OpenCompass MedBench portal: Chinese medical benchmark platform for evaluating LLMs on clinical knowledge and tasks. Not applicable (entity) · unknown · unknown resource · zh - ### [MedHELM](/evaluation/benchmarks-and-leaderboards/medhelm/index.md) Creator not supplied; see original source. Stanford CRFM MedHELM: evaluation of language models on clinician-defined medical tasks beyond exam-style questions. Not applicable (entity) · unknown · unknown resource · en - ### [MedHELM (Stanford CRFM)](/evaluation/benchmarks-and-leaderboards/medhelm-stanford-crfm/index.md) Creator not supplied; see original source. Latest MedHELM results page from Stanford CRFM, scoring language models on a taxonomy of real clinical tasks. Not applicable (entity) · unknown · unknown resource · en - ### [MedMNIST](/evaluation/benchmarks-and-leaderboards/medmnist/index.md) Creator not supplied; see original source. MedMNIST site: standardised 2D and 3D biomedical image classification datasets for lightweight benchmarking. Not applicable (entity) · unknown · unknown resource · en - ### [MedQA](/evaluation/benchmarks-and-leaderboards/medqa/index.md) Creator not supplied; see original source. MedQA GitHub repo: data and baselines for open-domain medical exam question answering. Not applicable (entity) · unknown · unknown resource · en - ### [Melting Pot](/evaluation/benchmarks-and-leaderboards/melting-pot/index.md) Creator not supplied; see original source. DeepMind Melting Pot GitHub repo: test scenarios for generalisation in multi-agent reinforcement learning. Not applicable (entity) · unknown · unknown resource · en - ### [MERA-Evaluation/MERA](/evaluation/benchmarks-and-leaderboards/mera/index.md) Creator not supplied; see original source. MERA GitHub repo: Russian-language instruction benchmark with open task definitions and an evaluation harness. Not applicable (entity) · unknown · unknown resource · ru - ### [MERA (Alliance in AI)](/evaluation/benchmarks-and-leaderboards/mera-alliance-in-ai/index.md) Creator not supplied; see original source. MERA site in Russian: open benchmark evaluating foundation models on Russian-language tasks, with leaderboards. Not applicable (entity) · unknown · unknown resource · ru - ### [MERA Code](/evaluation/benchmarks-and-leaderboards/mera-code/index.md) Creator not supplied; see original source. MERA Code GitHub repo: a benchmark for evaluating code generation by LLMs on tasks described in Russian. Not applicable (entity) · unknown · unknown resource · ru - ### [MERA Code / SWE-MERA](/evaluation/benchmarks-and-leaderboards/mera-code-swe-mera/index.md) Creator not supplied; see original source. MERA Code and SWE-MERA: benchmarks of code generation and software-engineering agents for Russian-language tasks. Not applicable (entity) · unknown · unknown resource · ru - ### [MERA Industrial](/evaluation/benchmarks-and-leaderboards/mera-industrial/index.md) Creator not supplied; see original source. MERA Industrial: benchmark of foundation models on industry-specific Russian-language tasks. Not applicable (entity) · unknown · unknown resource · ru - ### [MERA leaderboard and ecosystem](/evaluation/benchmarks-and-leaderboards/mera-leaderboard-and-ecosystem/index.md) Creator not supplied; see original source. MERA portal: Russian-language benchmark leaderboard for foundation models, with methodology and task categories. Not applicable (entity) · unknown · unknown resource · ru [Previous page](/evaluation/page/6/index.md) [Next page](/evaluation/page/8/index.md) [Plain-text Markdown copy](/evaluation/page/7/index.md)