Evaluation

Measure model capabilities and application behavior with explicit criteria.

• Benchmarks And Leaderboards (512)
• Eval Harnesses (3)
• Application Evals (2)
• Llm As Judge (1)
• Agent Evals (1)

519 resources · page 3 of 17

• BLEnD

  Creator not supplied; see original source.

  BLEnD paper: a benchmark of everyday cultural knowledge questions across many countries and languages for evaluating LLMs.

  Not applicable (entity) · unknown · unknown resource · mul

• BLINK

  Creator not supplied; see original source.

  BLINK project page: benchmark of visual perception tasks that multimodal LLMs find hard, such as depth and correspondence.

  Not applicable (entity) · unknown · unknown resource · en

• BRIGHT

  Creator not supplied; see original source.

  BRIGHT benchmark site: retrieval tasks that need reasoning beyond keyword or semantic matching, with leaderboard.

  Not applicable (entity) · unknown · unknown resource · en

• BrowserGym

  Creator not supplied; see original source.

  ServiceNow BrowserGym GitHub repo: Gym environment for evaluating web task automation agents.

  Not applicable (entity) · unknown · unknown resource · en

• C-Eval

  Creator not supplied; see original source.

  C-Eval GitHub repo: Chinese multi-subject evaluation suite for foundation models, with data and leaderboard.

  Not applicable (entity) · unknown · unknown resource · en

• CAC generative AI service filing count (Guangming Daily)

  Creator not supplied; see original source.

  Guangming report (July 2026): CAC count of 988 generative AI services filed by 30 June.

  Not applicable (entity) · unknown · unknown resource · zh

• CAFA 5 on Kaggle

  Creator not supplied; see original source.

  Kaggle page for CAFA 5, a competition on predicting protein function from sequence data.

  Not applicable (entity) · unknown · unknown resource · en

• CAFA (Critical Assessment of Function Annotation)

  Creator not supplied; see original source.

  CAFA site: the Critical Assessment of Function Annotation, a community challenge for predicting protein function.

  Not applicable (entity) · unknown · unknown resource · en

• CAICT 2026-H2 intelligent-system observability assessment

  Creator not supplied; see original source.

  The Paper report in Chinese on CAICT launching its 2026 H2 assessment of intelligent-system observability standards.

  Not applicable (entity) · unknown · unknown resource · zh

• CAICT 2026 launch notice (WeChat)

  Creator not supplied; see original source.

  CAICT WeChat notice in Chinese announcing its 2026 AI evaluation rounds.

  Not applicable (entity) · unknown · unknown resource · zh

• CAICT 方升 (Fangsheng) benchmark, 2026-02 seminar

  Creator not supplied; see original source.

  China.com report on CAICT's Fangsheng AI evaluation seminar, describing the Fangsheng 3.0 benchmark system and its rankings.

  Not applicable (entity) · unknown · unknown resource · zh

• CALVIN

  Creator not supplied; see original source.

  CALVIN GitHub repo: benchmark for language-conditioned long-horizon robot manipulation policies.

  Not applicable (entity) · unknown · unknown resource · en

• CAMEO

  Creator not supplied; see original source.

  CAMEO platform: weekly automated, blind benchmarking of protein structure prediction servers against newly released structures.

  Not applicable (entity) · unknown · unknown resource · en

• Canadian Artificial Intelligence Safety Institute (CAISI)

  Creator not supplied; see original source.

  Canadian Artificial Intelligence Safety Institute page on the ISED government site.

  Not applicable (entity) · unknown · unknown resource · en|fr

• CARLA Autonomous Driving Leaderboard

  Creator not supplied; see original source.

  CARLA Autonomous Driving Leaderboard: simulator-based driving routes and scoring rules for evaluating complete driving agents.

  Not applicable (entity) · unknown · unknown resource · en

• CASP Prediction Center

  Creator not supplied; see original source.

  CASP Prediction Center: blind community assessment of protein structure prediction methods.

  Not applicable (entity) · unknown · unknown resource · en

• CASP17

  Creator not supplied; see original source.

  CASP17 site: the 2026 round of the Critical Assessment of protein Structure Prediction, with targets and assessment results.

  Not applicable (entity) · unknown · unknown resource · en

• ChartQA

  Creator not supplied; see original source.

  ChartQA GitHub repo: benchmark for question answering over charts.

  Not applicable (entity) · unknown · unknown resource · en

• ChemBench

  Creator not supplied; see original source.

  ChemBench GitHub repo: Python package and benchmark comparing LLMs with human chemists on chemistry knowledge and reasoning.

  Not applicable (entity) · unknown · unknown resource · en

• ChemBench Leaderboard (Hugging Face Space)

  Creator not supplied; see original source.

  ChemBench leaderboard Space: language and multimodal model scores on chemistry knowledge and reasoning.

  Not applicable (entity) · unknown · unknown resource · en

• ChinAI #261: First results from CAICT's AI Safety Benchmark

  Creator not supplied; see original source.

  ChinAI newsletter issue translating the first results of CAICT's AI Safety Benchmark for Chinese language models.

  Not applicable (entity) · unknown · unknown resource · en

• CIFAR-10 and CIFAR-100

  Creator not supplied; see original source.

  Creator-hosted page for the CIFAR-10 and CIFAR-100 image classification datasets, with download links and format details.

  Not applicable (entity) · unknown · unknown resource · en

• CMMLU

  Creator not supplied; see original source.

  CMMLU GitHub repo: Chinese multitask language-understanding benchmark with data, evaluation code and leaderboard.

  Not applicable (entity) · unknown · unknown resource · zh

• COCO

  Creator not supplied; see original source.

  COCO dataset site with detection, segmentation, keypoint and captioning tasks, download links and evaluation servers.

  Not applicable (entity) · unknown · unknown resource · en

• CodeClash

  Creator not supplied; see original source.

  CodeClash benchmark: AI coding agents compete in multi-round tournaments to pursue open-ended goals in codebases.

  Not applicable (entity) · unknown · unknown resource · en

• compar:IA

  Creator not supplied; see original source.

  compar:IA: French government platform for blind pairwise comparison of conversational AI models, with rankings.

  Not applicable (entity) · unknown · unknown resource · fr|eu

• CompassHub (评测集社区)

  Creator not supplied; see original source.

  OpenCompass CompassHub: Chinese community catalogue of evaluation datasets and benchmarks for searching and comparing LLM tests.

  Not applicable (entity) · unknown · unknown resource · zh

• COVID-19 Forecast Hub

  Creator not supplied; see original source.

  COVID-19 Forecast Hub: archive of multi-model COVID-19 forecasts and ensemble evaluations from US research teams.

  Not applicable (entity) · unknown · unknown resource · en

• Coze Loop

  Creator not supplied; see original source.

  Coze Loop GitHub repo: ByteDance's open platform for AI agent evaluation, observability and prompt optimisation.

  Not applicable (entity) · unknown · unknown resource · zh|en

• CValues

  Creator not supplied; see original source.

  CValues GitHub repo: benchmark and research on evaluating the values and safety of Chinese large language models.

  Not applicable (entity) · unknown · unknown resource · zh

• CVE-Bench

  Creator not supplied; see original source.

  CVE-Bench GitHub repo: benchmark of critical web-application vulnerabilities for testing whether AI agents can exploit them.

  Not applicable (entity) · unknown · unknown resource · en

• Cybench

  Creator not supplied; see original source.

  Cybench site: 40 professional capture-the-flag tasks for evaluating language models on cybersecurity skills.

  Not applicable (entity) · unknown · unknown resource · en

Plain-text Markdown copy