Evaluation & benchmarks
Evaluation & benchmarks
- agent & coding evals (85)
- autonomous driving (1)
- general leaderboards (248)
- modality evals (image/video/speech) (87)
- physics & simulation (1)
- safety & efficiency evals (44)
- safety evals (1)
- science & domain evals (45)
- vision (1)
513 resources · page 9 of 17
NAVSIM v2 navhard leaderboard
by AGC 2025
NAVSIM v2 navhard leaderboard Space: public leaderboard for end-to-end autonomous driving planning.
Nejumi / Japanese LLM Leaderboard
W&B llm-leaderboard GitHub repo: code and methodology for the Nejumi Leaderboard, which evaluates LLMs on Japanese tasks.
Nejumi LLM Leaderboard 4
by Weights & Biases Japan (CoreWeave)
Nejumi LLM Leaderboard 4 report (Weights & Biases Japan, now on CoreWeave Forge): evaluation of LLMs on Japanese tasks.
NIST CAISI
by NIST
NIST CAISI: US government center evaluating AI models and developing measurement standards.
NoLiMa
by Ali Modarressi et al. (Munich Center for Machine Learning)
NoLiMa paper: a long-context benchmark where the needle must be found without literal word overlap with the question.
nuScenes
nuScenes site: autonomous-driving dataset with camera, lidar and radar data plus detection, tracking and prediction benchmarks.
nuScenes leaderboards
nuScenes leaderboards: autonomous-driving benchmarks for detection, tracking, prediction and planning.
OALL Hugging Face organization
by Open Arabic LLM Leaderboard
Open Arabic LLM Leaderboard (OALL) Hugging Face organisation: evaluation of Arabic language models.
ObjectNet
ObjectNet site: real-world object recognition test set with controlled backgrounds, rotations and viewpoints.
OCRBench
by Yuliang Liu
MultimodalOCR GitHub repo: OCRBench evaluation of text recognition in large multimodal models.
OCRBench v2 leaderboard
by 99Franklin
OCRBench v2 leaderboard: scores of multimodal models on visual text localisation and reasoning tasks.
olmOCR-Bench
by Ai2
olmOCR GitHub repo from Ai2: PDF linearisation toolkit that includes olmOCR-Bench, unit-test cases for OCR quality.
OmniDocBench
by OpenDataLab
OmniDocBench GitHub repo: benchmark for document parsing covering layout, tables, formulas and OCR across document types.
Open ASR Leaderboard
Hugging Face Open ASR Leaderboard: word error rate and speed of speech recognition models on public datasets.
Open Catalyst Project
by Meta FAIR Chemistry and Carnegie Mellon University (Open Catalyst Project)
Open Catalyst Project site: atomistic datasets, models and challenges for AI-based catalyst discovery.
Open Graph Benchmark
by Open Graph Benchmark team (Stanford University)
Open Graph Benchmark site from Stanford: graph datasets, data loaders and evaluators for graph machine learning.
Open ITA LLM Leaderboard
by mii-llm
Open Ita LLM Leaderboard Hugging Face Space: filterable results of models on Italian benchmarks.
Open Ko-LLM Leaderboard
by upstage
Upstage Open Ko-LLM Leaderboard Space on Hugging Face for comparing language models on Korean benchmarks.
Open LLM French Leaderboard
by le-leadboard
Open LLM French Leaderboard Hugging Face Space: filterable results of models on French benchmarks.
Open LLM Leaderboard
by Hugging Face
Open LLM Leaderboard Space (archived): historical scores of open language models filterable by size.
Open LLM Turkish Leaderboard v0.2
Open LLM Turkish Leaderboard v0.2 Hugging Face Space: filterable results of models on Turkish benchmarks.
Open Persian LLM Leaderboard org readme
by Open Persian LLM Leaderboard team
Open Persian LLM Leaderboard organisation readme describing the Amirkabir University-led initiative.
Open Persian LLM Leaderboard (PartAI)
by Part DP AI
PartAI Open Persian LLM Leaderboard Hugging Face Space: comparison of models on Persian benchmarks.
Open PL LLM Leaderboard (SpeakLeash)
by SpeakLeash
SpeakLeash Open PL LLM Leaderboard Hugging Face Space: detailed results of models on Polish tasks.
Open Portuguese LLM Leaderboard
Open Portuguese LLM Leaderboard Hugging Face Space (archived): past results of models on Portuguese benchmarks.
Open VLM Leaderboard (OpenCompass)
by OpenCompass
OpenCompass Open VLM Leaderboard Space: vision-language model results aggregated from VLMEvalKit benchmarks.
OpenAI Evals
by OpenAI
OpenAI Evals GitHub repo: framework and registry for evaluating LLMs and LLM systems.
frontier-evals
by OpenAI
OpenAI frontier-evals GitHub repo: code for evaluations such as PaperBench and SWE-Lancer.
OpenAI MRCR
by OpenAI
OpenAI MRCR dataset: multi-round coreference resolution task for testing long-context retrieval, as reported in model cards.
OpenCompass 司南
by Shanghai AI Laboratory (OpenCompass)
OpenCompass leaderboard in Chinese: scores and rankings of language and multimodal models across ability dimensions.
OpenCompass
by OpenCompass
OpenCompass GitHub repo: LLM evaluation platform with configs for many datasets, inference, judging and leaderboards.
OpenCompass CompassRank: Multimodal Leaderboard
by Shanghai AI Laboratory (OpenCompass)
OpenCompass CompassRank multimodal leaderboard: scores of vision-language models across benchmarks.