--- id: "/tags/evaluation-benchmarks/page/7/" title: "Evaluation Benchmarks · page 7" url: "https://skillissue.dev/tags/evaluation-benchmarks/page/7/" --- # Evaluation Benchmarks [Beginner](/levels/beginner/index.md) [Intermediate](/levels/intermediate/index.md) [Advanced](/levels/advanced/index.md) [Expert](/levels/expert/index.md) 513 resources · page 7 of 17 - ### [LIBERO-Plus](/evaluation/benchmarks-and-leaderboards/libero-plus/index.md) by [Senyu Fei et al. (Tongji University)](https://www.tongji.edu.cn) LIBERO-Plus paper: a robustness analysis of vision-language-action models using systematically perturbed LIBERO manipulation tasks. entity benchmark China en - ### [LIBERO-PRO](/evaluation/benchmarks-and-leaderboards/libero-pro/index.md) by [Xueyang Zhou et al. (Huazhong University of Science and Technology)](https://english.hust.edu.cn/) LIBERO-PRO paper testing vision-language-action models under perturbed objects, instructions and environments to check if LIBERO scores generalise. entity benchmark China (per search) en - ### [LiveBench](/evaluation/benchmarks-and-leaderboards/livebench/index.md) by [LiveBench team (Abacus.AI, NYU, NVIDIA and others)](https://livebench.ai/) LiveBench 2.0: regularly refreshed, contamination-limited benchmark of long-horizon real-work tasks. entity leaderboard West en - ### [LiveCodeBench](/evaluation/benchmarks-and-leaderboards/livecodebench/index.md) by [LiveCodeBench](https://github.com/LiveCodeBench) LiveCodeBench leaderboard: code generation results on problems collected from recent programming contests. entity leaderboard West en - ### [LiveMedBench](/evaluation/benchmarks-and-leaderboards/livemedbench/index.md) by [alphaXiv](https://www.alphaxiv.org/) LiveMedBench paper page: a continuously refreshed medical LLM benchmark built from real clinical cases with automated rubric scoring. entity benchmark unstated en - ### [LLM-jp Eval](/evaluation/benchmarks-and-leaderboards/llm-jp-eval/index.md) by [llm-jp](https://llm-jp.nii.ac.jp/) llm-jp-eval GitHub repo: tool for automatically evaluating Japanese LLMs across multiple datasets. entity benchmark Japan ja - ### [Arena text-to-image leaderboard](/evaluation/benchmarks-and-leaderboards/lmarena-text-to-image/index.md) by [Arena (formerly LMArena)](https://arena.ai/) Arena (formerly LMArena) text-to-image leaderboard: human-preference rankings of image generation models. entity leaderboard US en - ### [Arena text-to-video leaderboard](/evaluation/benchmarks-and-leaderboards/lmarena-text-to-video/index.md) by [Arena (formerly LMArena)](https://arena.ai/) Arena (formerly LMArena) text-to-video leaderboard: human-preference rankings of video generation models. entity leaderboard US en - ### [Arena Leaderboard (formerly LMArena)](/evaluation/benchmarks-and-leaderboards/lmarena-text-webdev-vision-text-to-image-video-search-arenas/index.md) by [Arena (formerly LMArena)](https://arena.ai/) Arena (formerly LMArena) leaderboards: human-preference rankings across text, webdev, vision, image, video and search arenas. entity leaderboard West en - ### [LMMS-Eval](/evaluation/benchmarks-and-leaderboards/lmms-eval/index.md) by [LMMs-Lab](https://github.com/EvolvingLMMs-Lab) LMMS-Eval GitHub repo: evaluation toolkit for multimodal models across text, image, video and audio tasks. entity repo International en - ### [LongBench](/evaluation/benchmarks-and-leaderboards/longbench/index.md) by [THUKEG](https://huggingface.co/THUDM) LongBench GitHub repo from THUDM: bilingual long-context benchmarks LongBench v1 and v2 with datasets and evaluation code. entity benchmark China zh - ### [Probing the limitations of multimodal language models for chemistry and materials research (MaCBench)](/evaluation/benchmarks-and-leaderboards/macbench-multimodal-chemistry-materials/index.md) by [Nawaf Alampara et al. (Friedrich Schiller University Jena)](https://www.uni-jena.de/en) MaCBench paper probing multimodal language models on chemistry and materials-science tasks such as reading spectra and lab images. entity benchmark Germany en - ### [ManiSkill](/evaluation/benchmarks-and-leaderboards/maniskill/index.md) by [Hillbot and UC San Diego (ManiSkill)](https://www.maniskill.ai/) ManiSkill site: GPU-accelerated simulation environments for training and evaluating robot manipulation policies at scale. entity benchmark US / International en - ### [MASK (Scale Labs leaderboard)](/evaluation/benchmarks-and-leaderboards/mask-scale-labs-leaderboard/index.md) by [Scale AI](https://scale.com/) Scale Labs MASK leaderboard: benchmark by Scale AI and CAIS measuring honesty separately from accuracy. entity leaderboard US (Scale + CAIS) en - ### [Matbench](/evaluation/benchmarks-and-leaderboards/matbench/index.md) by [Materials Project](https://www.materialsproject.org) Materials Project Matbench GitHub repo: benchmark tasks for materials property prediction. entity repo US / International en - ### [Matbench Discovery](/evaluation/benchmarks-and-leaderboards/matbench-discovery/index.md) by [Janosh Riebesell](https://janosh.dev) Matbench Discovery GitHub repo: evaluation framework for ML models in materials stability discovery. entity repo International en - ### [MATH](/evaluation/benchmarks-and-leaderboards/math/index.md) by [Dan Hendrycks](https://danhendrycks.com) MATH dataset GitHub repo: competition mathematics problems with step-by-step solutions for evaluating reasoning. entity benchmark US en - ### [MathArena](/evaluation/benchmarks-and-leaderboards/matharena/index.md) by [MathArena team (SRI Lab, ETH Zurich)](https://matharena.ai/) MathArena: evaluation of LLMs on newly released math competitions and arXiv-derived problems to avoid contamination. entity leaderboard Switzerland (ETH SRI) en - ### [MathVision](/evaluation/benchmarks-and-leaderboards/mathvision/index.md) by [LLMs for Reasoning](https://github.com/mathllm) MATH-Vision project page: competition math problems with visual contexts for evaluating multimodal reasoning. entity benchmark China / International en - ### [MathVista](/evaluation/benchmarks-and-leaderboards/mathvista/index.md) by [mathvista](https://mathvista.github.io/) MathVista project page: benchmark of math reasoning in visual contexts such as charts, diagrams and figures. entity benchmark US / International en - ### [MedBench](/evaluation/benchmarks-and-leaderboards/medbench/index.md) by [Shanghai AI Laboratory (OpenCompass)](https://opencompass.org.cn/) OpenCompass MedBench portal: Chinese medical benchmark platform for evaluating LLMs on clinical knowledge and tasks. entity benchmark China zh - ### [MedHELM](/evaluation/benchmarks-and-leaderboards/medhelm/index.md) by [Stanford CRFM](https://crfm.stanford.edu/) Stanford CRFM MedHELM: evaluation of language models on clinician-defined medical tasks beyond exam-style questions. entity benchmark US en - ### [MedHELM (Stanford CRFM)](/evaluation/benchmarks-and-leaderboards/medhelm-stanford-crfm/index.md) by [Stanford CRFM](https://crfm.stanford.edu/) Latest MedHELM results page from Stanford CRFM, scoring language models on a taxonomy of real clinical tasks. entity benchmark US (Stanford) en - ### [MedMNIST](/evaluation/benchmarks-and-leaderboards/medmnist/index.md) by [MedMNIST team (Shanghai Jiao Tong University)](https://medmnist.com/) MedMNIST site: standardised 2D and 3D biomedical image classification datasets for lightweight benchmarking. entity benchmark China / International en - ### [MedQA](/evaluation/benchmarks-and-leaderboards/medqa/index.md) by [Di Jin](https://github.com/jind11) MedQA GitHub repo: data and baselines for open-domain medical exam question answering. entity repo US / China en - ### [Melting Pot](/evaluation/benchmarks-and-leaderboards/melting-pot/index.md) by [Google DeepMind](https://www.deepmind.com/) DeepMind Melting Pot GitHub repo: test scenarios for generalisation in multi-agent reinforcement learning. entity repo UK / US en - ### [MERA-Evaluation/MERA](/evaluation/benchmarks-and-leaderboards/mera/index.md) by [MERA Evaluation](https://mera.a-ai.ru/) MERA GitHub repo: Russian-language instruction benchmark with open task definitions and an evaluation harness. entity benchmark Russia ru - ### [MERA (Alliance in AI)](/evaluation/benchmarks-and-leaderboards/mera-alliance-in-ai/index.md) by [AI Alliance Russia](https://a-ai.ru/) MERA site in Russian: open benchmark evaluating foundation models on Russian-language tasks, with leaderboards. entity leaderboard RU ru - ### [MERA Code](/evaluation/benchmarks-and-leaderboards/mera-code/index.md) by [MERA Evaluation](https://mera.a-ai.ru/) MERA Code GitHub repo: a benchmark for evaluating code generation by LLMs on tasks described in Russian. entity benchmark Russia ru - ### [MERA Code / SWE-MERA](/evaluation/benchmarks-and-leaderboards/mera-code-swe-mera/index.md) by [AI Alliance Russia](https://a-ai.ru/) MERA Code and SWE-MERA: benchmarks of code generation and software-engineering agents for Russian-language tasks. entity leaderboard Russia ru - ### [MERA Industrial](/evaluation/benchmarks-and-leaderboards/mera-industrial/index.md) by [AI Alliance Russia](https://a-ai.ru/) MERA Industrial: benchmark of foundation models on industry-specific Russian-language tasks. entity leaderboard Russia ru - ### [MERA leaderboard and ecosystem](/evaluation/benchmarks-and-leaderboards/mera-leaderboard-and-ecosystem/index.md) by [AI Alliance Russia](https://a-ai.ru/) MERA portal: Russian-language benchmark leaderboard for foundation models, with methodology and task categories. entity benchmark Russia ru [Previous page](/tags/evaluation-benchmarks/page/6/index.md) [Next page](/tags/evaluation-benchmarks/page/8/index.md) [Plain-text Markdown copy](/tags/evaluation-benchmarks/page/7/index.md)