--- id: "/tags/evaluation-benchmarks/page/8/" title: "Evaluation Benchmarks · page 8" url: "https://skillissue.dev/tags/evaluation-benchmarks/page/8/" --- # Evaluation Benchmarks [Beginner](/levels/beginner/index.md) [Intermediate](/levels/intermediate/index.md) [Advanced](/levels/advanced/index.md) [Expert](/levels/expert/index.md) 513 resources · page 8 of 17 - ### [MERA leaderboard (RU)](/evaluation/benchmarks-and-leaderboards/mera-leaderboard-ru/index.md) by [AI Alliance Russia](https://a-ai.ru/) MERA leaderboard in Russian: current results for Text, Industrial, Code and Multi tracks with CSV and JSON export. entity leaderboard Russia ru - ### [MERA](/evaluation/benchmarks-and-leaderboards/mera-main-site/index.md) by [AI Alliance Russia](https://a-ai.ru/) MERA English site: open Russian-language benchmark for foundation models with Text, Reason, Code and Industrial tracks. entity leaderboard Russia ru - ### [MERA Multimodal](/evaluation/benchmarks-and-leaderboards/mera-multimodal/index.md) by [MERA Evaluation](https://mera.a-ai.ru/) MERA Multimodal GitHub repo: open benchmark for evaluating multimodal models in Russian, with task definitions and code. entity benchmark Russia ru - ### [Meta-World](/evaluation/benchmarks-and-leaderboards/meta-world/index.md) by [meta-world](https://github.com/meta-world) Meta-World site: 50 simulated robot manipulation tasks for benchmarking meta-reinforcement and multi-task learning. entity benchmark US en - ### [METR](/evaluation/benchmarks-and-leaderboards/metr/index.md) by [METR](https://metr.org/) METR: research nonprofit publishing evaluations of frontier AI models' autonomous capabilities and risks. entity leaderboard West en - ### [METR Time Horizons](/evaluation/benchmarks-and-leaderboards/metr-time-horizons/index.md) by [METR](https://metr.org/) METR time horizons page: measured length of tasks frontier models complete autonomously, tracked over time. entity leaderboard US en - ### [MILU](/evaluation/benchmarks-and-leaderboards/milu/index.md) by [AI4Bharat](https://huggingface.co/ai4bharat) AI4Bharat MILU dataset: multiple-choice questions across subjects in Indian languages for evaluating India-specific knowledge. entity benchmark India en|mul - ### [Minari](/evaluation/benchmarks-and-leaderboards/minari/index.md) by [Farama Foundation](https://farama.org/) Minari documentation: Python library and dataset standard for offline reinforcement learning research. entity benchmark International en - ### [MineRL](/evaluation/benchmarks-and-leaderboards/minerl/index.md) by [MineRL Labs](https://github.com/minerllabs) MineRL GitHub repo: Minecraft environments and human demonstrations for sample-efficient RL. entity repo US / International en - ### [mini-SWE-agent](/evaluation/benchmarks-and-leaderboards/mini-swe-agent/index.md) by [SWE-agent](https://mini-SWE-agent.com) mini-SWE-agent GitHub repo: a roughly 100-line reference agent for solving GitHub issues, used as a simple SWE-bench baseline. entity benchmark US en - ### [MIZAN Persian LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/mizan-persian-llm-leaderboard/index.md) by [MCINext](https://huggingface.co/MCINext) MIZAN Persian LLM leaderboard: Persian benchmarks including MT-Bench, IFEval and PerMMLU. entity leaderboard Iran fa - ### [MLCommons AILuminate](/evaluation/benchmarks-and-leaderboards/mlcommons-ailuminate/index.md) by [MLCommons](https://mlcommons.org/) MLCommons AILuminate page: safety benchmark for general-purpose chatbots, with jailbreak and agentic tracks listed. entity benchmark US (industry consortium) en|fr - ### [MLE-bench](/evaluation/benchmarks-and-leaderboards/mle-bench/index.md) by [Jun Shern Chan et al. (OpenAI)](https://openai.com/) MLE-bench paper from OpenAI: 75 Kaggle competitions used to evaluate AI agents on machine-learning engineering work. entity benchmark US (OpenAI) en - ### [MLPerf Client](/evaluation/benchmarks-and-leaderboards/mlperf-client/index.md) by [MLCommons](https://mlcommons.org/) MLCommons MLPerf Client page: benchmark for LLM and AI workload performance on personal computers. entity benchmark International en - ### [MLPerf Inference](/evaluation/benchmarks-and-leaderboards/mlperf-inference/index.md) by [MLCommons](https://mlcommons.org/) MLCommons MLPerf Inference Datacenter results: standardised throughput and latency of AI systems across models. entity leaderboard West en - ### [MLPerf Tiny](/evaluation/benchmarks-and-leaderboards/mlperf-tiny/index.md) by [MLCommons](https://mlcommons.org/) MLCommons MLPerf Tiny page: inference benchmark for embedded and low-power devices, with published results. entity benchmark International en - ### [MLPerf Training](/evaluation/benchmarks-and-leaderboards/mlperf-training/index.md) by [MLCommons](https://mlcommons.org/) MLCommons MLPerf Training page: benchmark measuring time to train models to target quality, with published results. entity benchmark International en - ### [MMAU](/evaluation/benchmarks-and-leaderboards/mmau/index.md) by [mmaubench](https://github.com/mmaubench) MMAU project page: audio understanding and reasoning benchmark over speech, music and environmental sounds. entity benchmark International en - ### [MMAU-Pro](/evaluation/benchmarks-and-leaderboards/mmau-pro/index.md) by [Sonal Kumar](https://github.com/sonalkum) MMAU-Pro GitHub repo: benchmark for audio understanding and reasoning in audio-language models. entity repo International en - ### [MMBench](/evaluation/benchmarks-and-leaderboards/mmbench/index.md) by [OpenCompass](https://opencompass.org.cn) OpenCompass MMBench GitHub repo: multimodal evaluation benchmark in multiple languages. entity repo China zh - ### [MMLU](/evaluation/benchmarks-and-leaderboards/mmlu/index.md) by [Dan Hendrycks](https://danhendrycks.com) MMLU GitHub repo: the original Measuring Massive Multitask Language Understanding test with 57 subjects and evaluation code. entity benchmark US en - ### [MMLU-Pro](/evaluation/benchmarks-and-leaderboards/mmlu-pro/index.md) by [TIGER Lab](https://github.com/TIGER-AI-Lab) MMLU-Pro GitHub repo: code and data for a harder, ten-option version of MMLU for evaluating language models. entity benchmark US / International en - ### [MMLU-ProX](/evaluation/benchmarks-and-leaderboards/mmlu-prox/index.md) by [LiLab](https://huggingface.co/li-lab) MMLU-ProX dataset: MMLU-Pro translated into many languages for cross-lingual reasoning evaluation. entity benchmark Global - ### [MMMU](/evaluation/benchmarks-and-leaderboards/mmmu/index.md) by [MMMU](https://github.com/MMMU-Benchmark) MMMU project site: college-level multimodal reasoning benchmark across disciplines, including MMMU-Pro and leaderboards. entity benchmark US / International en - ### [MOSES](/evaluation/benchmarks-and-leaderboards/moses/index.md) by [MOSES](https://github.com/molecularsets) MOSES GitHub repo: benchmarking platform with metrics and baselines for molecular generation models. entity repo Russia / International en - ### [MTEB Leaderboard](/evaluation/benchmarks-and-leaderboards/mteb/index.md) by [Massive Text Embedding Benchmark](https://huggingface.co/mteb) MTEB leaderboard Space: embedding model scores across many retrieval, clustering and classification tasks. entity leaderboard West mul - ### [embeddings-benchmark/mteb](/evaluation/benchmarks-and-leaderboards/mteb-mmteb-github/index.md) by [Massive Text Embedding Benchmark](https://github.com/embeddings-benchmark) MTEB GitHub repo: Massive Text Embedding Benchmark code for evaluating embedding models across tasks and languages. entity benchmark Global mul - ### [MuChoMusic](/evaluation/benchmarks-and-leaderboards/muchomusic/index.md) by [MuLaB](https://github.com/mulab-mir) MuChoMusic GitHub repo: benchmark for music understanding in audio language models. entity repo Germany / International en - ### [Music Arena](/evaluation/benchmarks-and-leaderboards/music-arena/index.md) by [Music Arena team (Carnegie Mellon University)](https://music-arena.org/) Music Arena: arena where users vote between anonymous text-to-music generations to rank models. entity leaderboard US (academic) en - ### [MusTBench](/evaluation/benchmarks-and-leaderboards/mustbench/index.md) by [Sony](https://www.sony.com/en/) Sony MusTBench GitHub repo: benchmark for temporal grounding of music in large audio-language models. entity repo Japan / International en - ### [MVBench (OpenGVLab/Ask-Anything)](/evaluation/benchmarks-and-leaderboards/mvbench/index.md) by [OpenGVLab](https://github.com/OpenGVLab) OpenGVLab Ask-Anything GitHub repo: VideoChat models and the MVBench video understanding benchmark. entity repo China en - ### [NAVSIM (v2)](/evaluation/benchmarks-and-leaderboards/navsim-v2/index.md) by [autonomousvision](https://github.com/autonomousvision) NAVSIM GitHub repo: pseudo-simulation benchmark for evaluating end-to-end autonomous-driving planners. entity benchmark Germany (Tübingen) / China (OpenDriveLab) en [Previous page](/tags/evaluation-benchmarks/page/7/index.md) [Next page](/tags/evaluation-benchmarks/page/9/index.md) [Plain-text Markdown copy](/tags/evaluation-benchmarks/page/8/index.md)