--- id: "/evaluation/benchmarks-and-leaderboards/page/8/" title: "Benchmarks And Leaderboards: 512 curated resources · page 8" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/evaluation/benchmarks-and-leaderboards/page/8/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Benchmarks And Leaderboards: 512 curated resources Curated material on benchmarks and leaderboards within evaluation. [Beginner](/evaluation/beginner/index.md) [Intermediate](/evaluation/intermediate/index.md) [Advanced](/evaluation/advanced/index.md) [Expert](/evaluation/expert/index.md) 512 resources · page 8 of 16 - ### [MERA](/evaluation/benchmarks-and-leaderboards/mera-main-site/index.md) Creator not supplied; see original source. MERA English site: open Russian-language benchmark for foundation models with Text, Reason, Code and Industrial tracks. Not applicable (entity) · unknown · unknown resource · ru - ### [MERA Multimodal](/evaluation/benchmarks-and-leaderboards/mera-multimodal/index.md) Creator not supplied; see original source. MERA Multimodal GitHub repo: open benchmark for evaluating multimodal models in Russian, with task definitions and code. Not applicable (entity) · unknown · unknown resource · ru - ### [Meta-World](/evaluation/benchmarks-and-leaderboards/meta-world/index.md) Creator not supplied; see original source. Meta-World site: 50 simulated robot manipulation tasks for benchmarking meta-reinforcement and multi-task learning. Not applicable (entity) · unknown · unknown resource · en - ### [METR](/evaluation/benchmarks-and-leaderboards/metr/index.md) Creator not supplied; see original source. METR: research nonprofit publishing evaluations of frontier AI models' autonomous capabilities and risks. Not applicable (entity) · unknown · unknown resource · en - ### [METR Time Horizons](/evaluation/benchmarks-and-leaderboards/metr-time-horizons/index.md) Creator not supplied; see original source. METR time horizons page: measured length of tasks frontier models complete autonomously, tracked over time. Not applicable (entity) · unknown · unknown resource · en - ### [MILU](/evaluation/benchmarks-and-leaderboards/milu/index.md) Creator not supplied; see original source. AI4Bharat MILU dataset: multiple-choice questions across subjects in Indian languages for evaluating India-specific knowledge. Not applicable (entity) · unknown · unknown resource · en|mul - ### [Minari](/evaluation/benchmarks-and-leaderboards/minari/index.md) Creator not supplied; see original source. Minari documentation: Python library and dataset standard for offline reinforcement learning research. Not applicable (entity) · unknown · unknown resource · en - ### [MineRL](/evaluation/benchmarks-and-leaderboards/minerl/index.md) Creator not supplied; see original source. MineRL GitHub repo: Minecraft environments and human demonstrations for sample-efficient RL. Not applicable (entity) · unknown · unknown resource · en - ### [mini-SWE-agent](/evaluation/benchmarks-and-leaderboards/mini-swe-agent/index.md) Creator not supplied; see original source. mini-SWE-agent GitHub repo: a roughly 100-line reference agent for solving GitHub issues, used as a simple SWE-bench baseline. Not applicable (entity) · unknown · unknown resource · en - ### [MIZAN Persian LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/mizan-persian-llm-leaderboard/index.md) Creator not supplied; see original source. MIZAN Persian LLM leaderboard: Persian benchmarks including MT-Bench, IFEval and PerMMLU. Not applicable (entity) · unknown · unknown resource · fa - ### [MLCommons AILuminate](/evaluation/benchmarks-and-leaderboards/mlcommons-ailuminate/index.md) Creator not supplied; see original source. MLCommons AILuminate page: safety benchmark for general-purpose chatbots, with jailbreak and agentic tracks listed. Not applicable (entity) · unknown · unknown resource · en|fr - ### [MLE-bench](/evaluation/benchmarks-and-leaderboards/mle-bench/index.md) Creator not supplied; see original source. MLE-bench paper from OpenAI: 75 Kaggle competitions used to evaluate AI agents on machine-learning engineering work. Not applicable (entity) · unknown · unknown resource · en - ### [MLPerf Client](/evaluation/benchmarks-and-leaderboards/mlperf-client/index.md) Creator not supplied; see original source. MLCommons MLPerf Client page: benchmark for LLM and AI workload performance on personal computers. Not applicable (entity) · unknown · unknown resource · en - ### [MLPerf Inference](/evaluation/benchmarks-and-leaderboards/mlperf-inference/index.md) Creator not supplied; see original source. MLCommons MLPerf Inference Datacenter results: standardised throughput and latency of AI systems across models. Not applicable (entity) · unknown · unknown resource · en - ### [MLPerf Tiny](/evaluation/benchmarks-and-leaderboards/mlperf-tiny/index.md) Creator not supplied; see original source. MLCommons MLPerf Tiny page: inference benchmark for embedded and low-power devices, with published results. Not applicable (entity) · unknown · unknown resource · en - ### [MLPerf Training](/evaluation/benchmarks-and-leaderboards/mlperf-training/index.md) Creator not supplied; see original source. MLCommons MLPerf Training page: benchmark measuring time to train models to target quality, with published results. Not applicable (entity) · unknown · unknown resource · en - ### [MMAU](/evaluation/benchmarks-and-leaderboards/mmau/index.md) Creator not supplied; see original source. MMAU project page: audio understanding and reasoning benchmark over speech, music and environmental sounds. Not applicable (entity) · unknown · unknown resource · en - ### [MMAU-Pro](/evaluation/benchmarks-and-leaderboards/mmau-pro/index.md) Creator not supplied; see original source. MMAU-Pro GitHub repo: benchmark for audio understanding and reasoning in audio-language models. Not applicable (entity) · unknown · unknown resource · en - ### [MMBench](/evaluation/benchmarks-and-leaderboards/mmbench/index.md) Creator not supplied; see original source. OpenCompass MMBench GitHub repo: multimodal evaluation benchmark in multiple languages. Not applicable (entity) · unknown · unknown resource · zh - ### [MMLU](/evaluation/benchmarks-and-leaderboards/mmlu/index.md) Creator not supplied; see original source. MMLU GitHub repo: the original Measuring Massive Multitask Language Understanding test with 57 subjects and evaluation code. Not applicable (entity) · unknown · unknown resource · en - ### [MMLU-Pro](/evaluation/benchmarks-and-leaderboards/mmlu-pro/index.md) Creator not supplied; see original source. MMLU-Pro GitHub repo: code and data for a harder, ten-option version of MMLU for evaluating language models. Not applicable (entity) · unknown · unknown resource · en - ### [MMLU-ProX](/evaluation/benchmarks-and-leaderboards/mmlu-prox/index.md) Creator not supplied; see original source. MMLU-ProX dataset: MMLU-Pro translated into many languages for cross-lingual reasoning evaluation. Not applicable (entity) · unknown · unknown resource · und - ### [MMMU](/evaluation/benchmarks-and-leaderboards/mmmu/index.md) Creator not supplied; see original source. MMMU project site: college-level multimodal reasoning benchmark across disciplines, including MMMU-Pro and leaderboards. Not applicable (entity) · unknown · unknown resource · en - ### [MOSES](/evaluation/benchmarks-and-leaderboards/moses/index.md) Creator not supplied; see original source. MOSES GitHub repo: benchmarking platform with metrics and baselines for molecular generation models. Not applicable (entity) · unknown · unknown resource · en - ### [MTEB Leaderboard](/evaluation/benchmarks-and-leaderboards/mteb/index.md) Creator not supplied; see original source. MTEB leaderboard Space: embedding model scores across many retrieval, clustering and classification tasks. Not applicable (entity) · unknown · unknown resource · mul - ### [embeddings-benchmark/mteb](/evaluation/benchmarks-and-leaderboards/mteb-mmteb-github/index.md) Creator not supplied; see original source. MTEB GitHub repo: Massive Text Embedding Benchmark code for evaluating embedding models across tasks and languages. Not applicable (entity) · unknown · unknown resource · mul - ### [MuChoMusic](/evaluation/benchmarks-and-leaderboards/muchomusic/index.md) Creator not supplied; see original source. MuChoMusic GitHub repo: benchmark for music understanding in audio language models. Not applicable (entity) · unknown · unknown resource · en - ### [Music Arena](/evaluation/benchmarks-and-leaderboards/music-arena/index.md) Creator not supplied; see original source. Music Arena: arena where users vote between anonymous text-to-music generations to rank models. Not applicable (entity) · unknown · unknown resource · en - ### [MusTBench](/evaluation/benchmarks-and-leaderboards/mustbench/index.md) Creator not supplied; see original source. Sony MusTBench GitHub repo: benchmark for temporal grounding of music in large audio-language models. Not applicable (entity) · unknown · unknown resource · en - ### [MVBench (OpenGVLab/Ask-Anything)](/evaluation/benchmarks-and-leaderboards/mvbench/index.md) Creator not supplied; see original source. OpenGVLab Ask-Anything GitHub repo: VideoChat models and the MVBench video understanding benchmark. Not applicable (entity) · unknown · unknown resource · en - ### [NAVSIM (v2)](/evaluation/benchmarks-and-leaderboards/navsim-v2/index.md) Creator not supplied; see original source. NAVSIM GitHub repo: pseudo-simulation benchmark for evaluating end-to-end autonomous-driving planners. Not applicable (entity) · unknown · unknown resource · en - ### [NAVSIM v2 navhard leaderboard](/evaluation/benchmarks-and-leaderboards/navsim-v2-navhard-leaderboard/index.md) Creator not supplied; see original source. NAVSIM v2 navhard leaderboard Space: public leaderboard for end-to-end autonomous driving planning. Not applicable (entity) · unknown · unknown resource · en [Previous page](/evaluation/benchmarks-and-leaderboards/page/7/index.md) [Next page](/evaluation/benchmarks-and-leaderboards/page/9/index.md) [Plain-text Markdown copy](/evaluation/benchmarks-and-leaderboards/page/8/index.md)