Evaluation & benchmarks for advanced learners
452 resources · page 3 of 15
BLEnD
BLEnD paper: a benchmark of everyday cultural knowledge questions across many countries and languages for evaluating LLMs.
BLINK
by Xingyu Fu
BLINK project page: benchmark of visual perception tasks that multimodal LLMs find hard, such as depth and correspondence.
BRIGHT
BRIGHT benchmark site: retrieval tasks that need reasoning beyond keyword or semantic matching, with leaderboard.
BrowserGym
by ServiceNow
ServiceNow BrowserGym GitHub repo: Gym environment for evaluating web task automation agents.
C-Eval
C-Eval GitHub repo: Chinese multi-subject evaluation suite for foundation models, with data and leaderboard.
CAC generative AI service filing count (Guangming Daily)
Guangming report (July 2026): CAC count of 988 generative AI services filed by 30 June.
CAFA 5 on Kaggle
by CAFA (Critical Assessment of Functional Annotation)
Kaggle page for CAFA 5, a competition on predicting protein function from sequence data.
CAFA (Critical Assessment of Function Annotation)
CAFA site: the Critical Assessment of Function Annotation, a community challenge for predicting protein function.
CAICT 2026-H2 intelligent-system observability assessment
The Paper report in Chinese on CAICT launching its 2026 H2 assessment of intelligent-system observability standards.
CAICT 2026 launch notice (WeChat)
by China Academy of Information and Communications Technology (CAICT)
CAICT WeChat notice in Chinese announcing its 2026 AI evaluation rounds.
CAICT 方升 (Fangsheng) benchmark, 2026-02 seminar
China.com report on CAICT's Fangsheng AI evaluation seminar, describing the Fangsheng 3.0 benchmark system and its rankings.
CALVIN
by Oier Mees
CALVIN GitHub repo: benchmark for language-conditioned long-horizon robot manipulation policies.
CAMEO
by CAMEO (SIB Swiss Institute of Bioinformatics)
CAMEO platform: weekly automated, blind benchmarking of protein structure prediction servers against newly released structures.
Canadian Artificial Intelligence Safety Institute (CAISI)
by Government of Canada (ISED)
Canadian Artificial Intelligence Safety Institute page on the ISED government site.
CARLA Autonomous Driving Leaderboard
by CARLA team
CARLA Autonomous Driving Leaderboard: simulator-based driving routes and scoring rules for evaluating complete driving agents.
CASP Prediction Center
by Protein Structure Prediction Center (UC Davis)
CASP Prediction Center: blind community assessment of protein structure prediction methods.
CASP17
by Protein Structure Prediction Center (UC Davis)
CASP17 site: the 2026 round of the Critical Assessment of protein Structure Prediction, with targets and assessment results.
ChartQA
ChartQA GitHub repo: benchmark for question answering over charts.
ChemBench
by Laboratory for AI for Materials
ChemBench GitHub repo: Python package and benchmark comparing LLMs with human chemists on chemistry knowledge and reasoning.
ChemBench Leaderboard (Hugging Face Space)
by Lab of Kevin Jablonka at Uni Jena
ChemBench leaderboard Space: language and multimodal model scores on chemistry knowledge and reasoning.
ChinAI #261: First results from CAICT's AI Safety Benchmark
ChinAI newsletter issue translating the first results of CAICT's AI Safety Benchmark for Chinese language models.
CIFAR-10 and CIFAR-100
by Alex Krizhevsky (University of Toronto)
Creator-hosted page for the CIFAR-10 and CIFAR-100 image classification datasets, with download links and format details.
CMMLU
by Haonan Li
CMMLU GitHub repo: Chinese multitask language-understanding benchmark with data, evaluation code and leaderboard.
COCO
COCO dataset site with detection, segmentation, keypoint and captioning tasks, download links and evaluation servers.
CodeClash
CodeClash benchmark: AI coding agents compete in multi-round tournaments to pursue open-ended goals in codebases.
compar:IA
by French Ministry of Culture (compar:IA)
compar:IA: French government platform for blind pairwise comparison of conversational AI models, with rankings.
CompassHub (评测集社区)
by Shanghai AI Laboratory (OpenCompass)
OpenCompass CompassHub: Chinese community catalogue of evaluation datasets and benchmarks for searching and comparing LLM tests.
COVID-19 Forecast Hub
by COVID-19 Forecast Hub (Reich Lab, UMass Amherst)
COVID-19 Forecast Hub: archive of multi-model COVID-19 forecasts and ensemble evaluations from US research teams.
Coze Loop
by coze-dev
Coze Loop GitHub repo: ByteDance's open platform for AI agent evaluation, observability and prompt optimisation.
CValues
by X-PLUG
CValues GitHub repo: benchmark and research on evaluating the values and safety of Chinese large language models.
CVE-Bench
CVE-Bench GitHub repo: benchmark of critical web-application vulnerabilities for testing whether AI agents can exploit them.
Cybench
by cybench
Cybench site: 40 professional capture-the-flag tasks for evaluating language models on cybersecurity skills.