Benchmarks And Leaderboards: 512 curated resources

Curated material on benchmarks and leaderboards within evaluation.

512 resources · page 1 of 16

• China's Most Powerful Large Model: Who Is the Real No.1 Among All Claimants? (36Kr)

  Creator not supplied; see original source.

  36Kr article comparing Chinese models across SuperCLUE, Artificial Analysis and Arena rankings.

  Not applicable (entity) · unknown · unknown resource · en|zh

• 3D Arena (HF Space)

  Creator not supplied; see original source.

  3D Arena Space: voting arena and leaderboard for AI-generated 3D models.

  Not applicable (entity) · unknown · unknown resource · en

• 3DGen-Arena (3DTopia)

  Creator not supplied; see original source.

  3DTopia 3DGen-Arena Space: arena comparing open-source text- and image-to-3D generation models.

  Not applicable (entity) · unknown · unknown resource · en

• AA-3D

  Creator not supplied; see original source.

  Artificial Analysis AA-3D benchmark comparing how well AI models build interactive 3D experiences, judged by blind panel comparisons.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis Intelligence Benchmarking methodology

  Creator not supplied; see original source.

  Artificial Analysis methodology page describing the benchmarks, weights and scoring behind its Intelligence Index for LLMs.

  Not applicable (entity) · unknown · unknown resource · en

• ActivityNet

  Creator not supplied; see original source.

  ActivityNet GitHub repo: tools and evaluation code for the ActivityNet human activity benchmark.

  Not applicable (entity) · unknown · unknown resource · en

• AfroBench

  Creator not supplied; see original source.

  Masakhane AfroBench collection on Hugging Face: datasets for benchmarking LLMs across many African languages.

  Not applicable (entity) · unknown · unknown resource · en

• AfroBench site/leaderboard

  Creator not supplied; see original source.

  AfroBench site: benchmark evaluating LLMs on 64 African languages across 15 NLP tasks.

  Not applicable (entity) · unknown · unknown resource · mul

• AgentBench

  Creator not supplied; see original source.

  AgentBench GitHub repo (Tsinghua): benchmark evaluating LLMs as agents across multiple interactive environments.

  Not applicable (entity) · unknown · unknown resource · en

• AgentBoard

  Creator not supplied; see original source.

  HKUST AgentBoard GitHub repo: analytical evaluation board for multi-turn LLM agents with progress tracking.

  Not applicable (entity) · unknown · unknown resource · en

• ethz-spylab/agentdojo

  Creator not supplied; see original source.

  ETH SPY Lab AgentDojo GitHub repo: environment evaluating prompt injection attacks and defences for LLM agents.

  Not applicable (entity) · unknown · unknown resource · en

• ai-safety-institute/AgentHarm

  Creator not supplied; see original source.

  UK AISI AgentHarm dataset on Hugging Face: harmful agentic tasks for measuring whether LLM agents comply with misuse requests.

  Not applicable (entity) · unknown · unknown resource · en

• AGI-Eval (agi-eval.cn)

  Creator not supplied; see original source.

  AGI-Eval: Chinese arena-style platform for evaluating large language models.

  Not applicable (entity) · unknown · unknown resource · zh

• AI Fairness 360

  Creator not supplied; see original source.

  AIF360 GitHub repo (originally IBM): fairness metrics and bias mitigation algorithms for datasets and models.

  Not applicable (entity) · unknown · unknown resource · en

• AI Verify Foundation / Project Moonshot (Singapore)

  Creator not supplied; see original source.

  Singapore's AI Verify Foundation site, home of the AI Verify testing toolkit and Project Moonshot for LLM red-teaming and benchmarking.

  Not applicable (entity) · unknown · unknown resource · en

• AI4Bharat Launches Indic LLM Arena (CXO Digital Pulse)

  Creator not supplied; see original source.

  CXO Digital Pulse report on AI4Bharat's Indic LLM Arena, a crowd-sourced evaluation platform for Indian languages.

  Not applicable (entity) · unknown · unknown resource · mul

• Aider polyglot leaderboard

  Creator not supplied; see original source.

  Aider LLM leaderboards: model scores on polyglot code-editing exercises with cost.

  Not applicable (entity) · unknown · unknown resource · en

• AILuminate

  Creator not supplied; see original source.

  MLCommons AILuminate benchmark that rates the safety of general-purpose chat models' responses to hazardous text prompts.

  Not applicable (entity) · unknown · unknown resource · en

• AIR-Bench 2024

  Creator not supplied; see original source.

  AIR-Bench 2024 GitHub repo from Stanford CRFM: safety benchmark with a risk taxonomy drawn from regulations and company policies.

  Not applicable (entity) · unknown · unknown resource · en

• AlignBench

  Creator not supplied; see original source.

  AlignBench GitHub repo: multi-dimensional benchmark for evaluating alignment of Chinese LLMs, with reference answers.

  Not applicable (entity) · unknown · unknown resource · zh

• AlpaSim E2E Closed-Loop Challenge 2026

  Creator not supplied; see original source.

  OpenDriveLab AlpaSim 2026 challenge: closed-loop benchmark for autonomous-driving policies on safety, generalisation and efficiency.

  Not applicable (entity) · unknown · unknown resource · en

• AndroidWorld

  Creator not supplied; see original source.

  Google Research AndroidWorld GitHub repo: environment and benchmark for autonomous agents on Android.

  Not applicable (entity) · unknown · unknown resource · en

• Apollo Research

  Creator not supplied; see original source.

  Apollo Research site, an AI safety lab publishing evaluations of scheming and deceptive behaviour in frontier models.

  Not applicable (entity) · unknown · unknown resource · en

• AppWorld

  Creator not supplied; see original source.

  AppWorld benchmark: a simulated world of everyday apps and APIs for testing coding agents on stateful multi-app tasks.

  Not applicable (entity) · unknown · unknown resource · en

• ArabicMMLU

  Creator not supplied; see original source.

  ArabicMMLU GitHub repo: Arabic knowledge benchmark built from school exams across North African, Levantine and Gulf regions.

  Not applicable (entity) · unknown · unknown resource · ar

• Inception Multilingual Leaderboards

  Creator not supplied; see original source.

  Inception multilingual leaderboards Hugging Face Space, including AraGen for Arabic generation.

  Not applicable (entity) · unknown · unknown resource · ar

• ARC-AGI-3

  Creator not supplied; see original source.

  ARC-AGI-3 page from ARC Prize: an interactive benchmark where agents must learn the rules of novel game environments.

  Not applicable (entity) · unknown · unknown resource · mul

• ARC-AGI leaderboard

  Creator not supplied; see original source.

  ARC Prize leaderboard: model scores on ARC-AGI abstraction benchmarks plotted against cost per task.

  Not applicable (entity) · unknown · unknown resource · en

• Arcade Learning Environment

  Creator not supplied; see original source.

  Documentation for the Arcade Learning Environment, the Atari 2600 interface used to train and evaluate reinforcement-learning agents.

  Not applicable (entity) · unknown · unknown resource · en

• Arena Raises $200M Series B at $3.1B Valuation

  Creator not supplied; see original source.

  Arena blog post on its Series B and the launch of its AI Alignment Index, measuring unsafe agent behaviour on real traces.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis

  Creator not supplied; see original source.

  Artificial Analysis: independent benchmarks comparing AI models and API providers on intelligence, price, speed and latency.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis ASR leaderboard

  Creator not supplied; see original source.

  Artificial Analysis leaderboard for non-streaming speech-to-text, comparing word error rate, processing speed and price per model.

  Not applicable (entity) · unknown · unknown resource · en

Plain-text Markdown copy