General Leaderboards

248 resources · page 3 of 8

• Flames

  Creator not supplied; see original source.

  Flames GitHub repo: an adversarial Chinese benchmark of prompts on fairness, safety, morality, legality and data protection.

  Not applicable (entity) · unknown · unknown resource · zh

• GEO-Bench

  Creator not supplied; see original source.

  GEO-Bench GitHub repo from ServiceNow: benchmark for foundation models on Earth-observation classification and segmentation.

  Not applicable (entity) · unknown · unknown resource · en

• Global-MMLU

  Creator not supplied; see original source.

  Cohere Labs Global-MMLU dataset: MMLU translated into many languages with labels marking culturally sensitive questions.

  Not applicable (entity) · unknown · unknown resource · mul

• GLUE

  Creator not supplied; see original source.

  GLUE benchmark site: collection of natural-language-understanding tasks with a leaderboard for comparing models.

  Not applicable (entity) · unknown · unknown resource · en

• Habitat Challenge

  Creator not supplied; see original source.

  Annual Habitat Challenge for embodied AI, with simulated navigation and object-rearrangement tasks, rules and leaderboards for agent evaluation.

  Not applicable (entity) · unknown · unknown resource · en

• HAE-RAE Bench

  Creator not supplied; see original source.

  HAE-RAE Bench GitHub repo: a Korean benchmark on vocabulary, history, general knowledge and reading comprehension.

  Not applicable (entity) · unknown · unknown resource · ko

• Hebrew LLM Leaderboard

  Creator not supplied; see original source.

  Hebrew LLM Leaderboard Hugging Face Space: model results on Hebrew language benchmarks.

  Not applicable (entity) · unknown · unknown resource · he

• HELM (Stanford CRFM)

  Creator not supplied; see original source.

  Stanford CRFM HELM: holistic evaluation of language models across many scenarios and metrics.

  Not applicable (entity) · unknown · unknown resource · en

• HELMET

  Creator not supplied; see original source.

  HELMET GitHub repo from Princeton: benchmark for long-context language models across seven application categories.

  Not applicable (entity) · unknown · unknown resource · en

• HF Find a Leaderboard

  Creator not supplied; see original source.

  Hugging Face Find a Leaderboard Space: searchable directory of leaderboards hosted on the Hub.

  Not applicable (entity) · unknown · unknown resource · und

• Hugging Face LightEval

  Creator not supplied; see original source.

  Hugging Face LightEval GitHub repo: toolkit for evaluating LLMs across many backends and tasks.

  Not applicable (entity) · unknown · unknown resource · en

• Humanity's Last Exam

  Creator not supplied; see original source.

  Humanity's Last Exam: dataset of 2,500 expert-written questions across academic fields, with paper and results.

  Not applicable (entity) · unknown · unknown resource · en

• Humanloop

  Creator not supplied; see original source.

  Humanloop site, now a notice that the team joined Anthropic and the platform was shut down with a migration guide.

  Not applicable (entity) · unknown · unknown resource · en

• IberBench

  Creator not supplied; see original source.

  UPV repository record for IberBench, a benchmark for evaluating LLMs on Iberian languages such as Spanish, Catalan and Basque.

  Not applicable (entity) · unknown · unknown resource · mul

• IFBench

  Creator not supplied; see original source.

  IFBench paper on generalising verifiable instruction following, with out-of-distribution output constraints for evaluating LLMs.

  Not applicable (entity) · unknown · unknown resource · en

• INCLUDE

  Creator not supplied; see original source.

  Cohere Labs INCLUDE dataset: questions from local academic and professional exams in 44 languages for regional knowledge evaluation.

  Not applicable (entity) · unknown · unknown resource · mul

• IndicGLUE

  Creator not supplied; see original source.

  AI4Bharat IndicGLUE page: natural-language-understanding benchmark for Indian languages with tasks and datasets.

  Not applicable (entity) · unknown · unknown resource · mul

• IndoMMLU

  Creator not supplied; see original source.

  IndoMMLU dataset: questions from Indonesian school exams for evaluating language models on local knowledge.

  Not applicable (entity) · unknown · unknown resource · id

• IndoNLU

  Creator not supplied; see original source.

  IndoNLU GitHub repo: Indonesian natural-language-understanding benchmark with tasks, pretrained models and starter code.

  Not applicable (entity) · unknown · unknown resource · en

• InfiniteBench

  Creator not supplied; see original source.

  InfiniteBench GitHub repo: long-context tasks beyond 100K tokens for evaluating language models.

  Not applicable (entity) · unknown · unknown resource · en

• Inspect Evals

  Creator not supplied; see original source.

  UK AISI inspect_evals GitHub repo: collection of evaluations implemented for the Inspect AI framework.

  Not applicable (entity) · unknown · unknown resource · en

• IrokoBench

  Creator not supplied; see original source.

  Masakhane IrokoBench collection on Hugging Face: human-translated NLI, MMLU and math tasks in 16 African languages.

  Not applicable (entity) · unknown · unknown resource · en

• ISP RAS Trusted AI Research Center

  Creator not supplied; see original source.

  ISP RAS research center for trustworthy AI: unit of the Russian Academy of Sciences' Institute for System Programming.

  Not applicable (entity) · unknown · unknown resource · ru

• JGLUE

  Creator not supplied; see original source.

  JGLUE GitHub repo from Yahoo Japan: Japanese general language understanding benchmark built natively in Japanese.

  Not applicable (entity) · unknown · unknown resource · ja

• JudgeBench

  Creator not supplied; see original source.

  JudgeBench GitHub repo: benchmark for evaluating LLM-based judges on verifiable response-comparison tasks.

  Not applicable (entity) · unknown · unknown resource · en

• Kazakh LLM leaderboard

  Creator not supplied; see original source.

  Kaz LLM Leaderboard Hugging Face Space: Kazakh-language benchmark results with model submissions.

  Not applicable (entity) · unknown · unknown resource · kk

• KazMMLU

  Creator not supplied; see original source.

  KazMMLU paper: a knowledge benchmark of Kazakhstan-specific questions in Kazakh and Russian for evaluating language models.

  Not applicable (entity) · unknown · unknown resource · kk|ru

• KLUE

  Creator not supplied; see original source.

  KLUE GitHub repo: Korean natural-language-understanding benchmark with eight tasks and baseline code.

  Not applicable (entity) · unknown · unknown resource · ko

• KMMLU

  Creator not supplied; see original source.

  KMMLU paper: a Korean multitask knowledge benchmark written natively in Korean rather than translated from English MMLU.

  Not applicable (entity) · unknown · unknown resource · en

• KMMLU-Redux and KMMLU-Pro

  Creator not supplied; see original source.

  Paper introducing KMMLU-Redux, a corrected version of KMMLU, and KMMLU-Pro, built from Korean professional licensing exams.

  Not applicable (entity) · unknown · unknown resource · en

• KMMLU-Redux / KMMLU-Pro

  Creator not supplied; see original source.

  LG AI Research publication page for KMMLU-Redux and KMMLU-Pro, Korean benchmarks built from professional licensing exams.

  Not applicable (entity) · unknown · unknown resource · ko

• La Leaderboard

  Creator not supplied; see original source.

  La Leaderboard Hugging Face Space: evaluation of LLMs on Spanish and other languages of Spain and Latin America.

  Not applicable (entity) · unknown · unknown resource · es|ca|eu|gl

Plain-text Markdown copy