--- id: "/evaluation/page/13/" title: "Evaluation · page 13" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/evaluation/page/13/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Evaluation Measure model capabilities and application behavior with explicit criteria. - [Benchmarks And Leaderboards](/evaluation/benchmarks-and-leaderboards/index.md) (512) - [Eval Harnesses](/evaluation/eval-harnesses/index.md) (3) - [Application Evals](/evaluation/application-evals/index.md) (2) - [Llm As Judge](/evaluation/llm-as-judge/index.md) (1) - [Agent Evals](/evaluation/agent-evals/index.md) (1) [Beginner](/evaluation/beginner/index.md) [Intermediate](/evaluation/intermediate/index.md) [Advanced](/evaluation/advanced/index.md) [Expert](/evaluation/expert/index.md) 519 resources · page 13 of 17 - ### [VBench](/evaluation/benchmarks-and-leaderboards/vbench/index.md) Creator not supplied; see original source. VBench project page: benchmark suite scoring video generation models on separate quality and alignment dimensions. Not applicable (entity) · unknown · unknown resource · en - ### [VBench-2.0](/evaluation/benchmarks-and-leaderboards/vbench-2-0/index.md) Creator not supplied; see original source. VBench-2.0 project page: video generation benchmark for intrinsic faithfulness, including physics and commonsense consistency. Not applicable (entity) · unknown · unknown resource · en - ### [VBench Leaderboard (Hugging Face Space)](/evaluation/benchmarks-and-leaderboards/vbench-leaderboard-hf/index.md) Creator not supplied; see original source. VBench leaderboard Space: video generation model scores across VBench dimensions, with self-submission. Not applicable (entity) · unknown · unknown resource · en - ### [VBench / VBench++ / VBench-2.0](/evaluation/benchmarks-and-leaderboards/vbench-vbench-vbench-2-0/index.md) Creator not supplied; see original source. VBench GitHub repo: evaluation suite for video generation models across many quality and consistency dimensions. Not applicable (entity) · unknown · unknown resource · en - ### [Vectara Hallucination Leaderboard (HHEM)](/evaluation/benchmarks-and-leaderboards/vectara-hallucination-leaderboard-hhem/index.md) Creator not supplied; see original source. Vectara hallucination leaderboard GitHub repo: hallucination rates of LLMs when summarising documents, scored with HHEM. Not applicable (entity) · unknown · unknown resource · en - ### [Vellum LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/vellum-llm-leaderboard/index.md) Creator not supplied; see original source. Vellum LLM leaderboard: compact comparison of models on benchmarks, speed and cost, with an open-source tab. Not applicable (entity) · unknown · unknown resource · en - ### [MME-Benchmarks/Video-MME](/evaluation/benchmarks-and-leaderboards/video-mme/index.md) Creator not supplied; see original source. Video-MME GitHub repo: benchmark and evaluation resources for multimodal models' understanding of short to long videos. Not applicable (entity) · unknown · unknown resource · en - ### [Video-MME](/evaluation/benchmarks-and-leaderboards/video-mme-2/index.md) Creator not supplied; see original source. Video-MME project site: benchmark for multimodal models on short, medium and long videos with subtitles and audio. Not applicable (entity) · unknown · unknown resource · en - ### [Video-MME-v2](/evaluation/benchmarks-and-leaderboards/video-mme-v2/index.md) Creator not supplied; see original source. Video-MME-v2 paper: a video-understanding benchmark with group-based consistency scoring for multimodal models. Not applicable (entity) · unknown · unknown resource · en - ### [Vikhr Arena-Hard (RU) leaderboard](/evaluation/benchmarks-and-leaderboards/vikhr-arena-hard-ru-leaderboard/index.md) Creator not supplied; see original source. Vikhr Arena-Hard Russian leaderboard Hugging Face Space: Russian-language Arena-Hard results for LLMs. Not applicable (entity) · unknown · unknown resource · ru - ### [VisualWebArena](/evaluation/benchmarks-and-leaderboards/visualwebarena/index.md) Creator not supplied; see original source. VisualWebArena project page: benchmark of realistic web tasks where multimodal agents need visual information to succeed. Not applicable (entity) · unknown · unknown resource · en - ### [VLMEvalKit](/evaluation/benchmarks-and-leaderboards/vlmevalkit/index.md) Creator not supplied; see original source. OpenCompass VLMEvalKit GitHub repo: evaluation toolkit for large vision-language models. Not applicable (entity) · unknown · unknown resource · zh - ### [VMLU](/evaluation/benchmarks-and-leaderboards/vmlu/index.md) Creator not supplied; see original source. VMLU site: Vietnamese multitask language-understanding benchmark suite for LLMs from ZaloAI and JAIST. Not applicable (entity) · unknown · unknown resource · vi - ### [VQA v2](/evaluation/benchmarks-and-leaderboards/vqa-v2/index.md) Creator not supplied; see original source. VQA site: Visual Question Answering datasets and challenges for answering open questions about images. Not applicable (entity) · unknown · unknown resource · en - ### [W&B Weave](/evaluation/benchmarks-and-leaderboards/w-b-weave/index.md) Creator not supplied; see original source. W&B Weave GitHub repo: toolkit for tracing and evaluating AI applications. Not applicable (entity) · unknown · unknown resource · en - ### [Waymo Open Dataset](/evaluation/benchmarks-and-leaderboards/waymo-open-dataset/index.md) Creator not supplied; see original source. Waymo Open Dataset site: autonomous-driving perception and motion data with annual challenges. Not applicable (entity) · unknown · unknown resource · en - ### [Waymo Open Dataset challenges](/evaluation/benchmarks-and-leaderboards/waymo-open-dataset-challenges/index.md) Creator not supplied; see original source. Waymo Open Dataset challenges: autonomous-driving tasks and leaderboards on perception, prediction and planning. Not applicable (entity) · unknown · unknown resource · en - ### [WeatherBench 2](/evaluation/benchmarks-and-leaderboards/weatherbench-2/index.md) Creator not supplied; see original source. Google Research WeatherBench 2: benchmark, datasets and metrics for comparing data-driven global weather forecasting models. Not applicable (entity) · unknown · unknown resource · en - ### [WebArena](/evaluation/benchmarks-and-leaderboards/webarena/index.md) Creator not supplied; see original source. WebArena: suite of self-hosted website environments for benchmarking autonomous web agents. Not applicable (entity) · unknown · unknown resource · en - ### [WILDS](/evaluation/benchmarks-and-leaderboards/wilds/index.md) Creator not supplied; see original source. WILDS benchmark site from Stanford: real-world datasets with natural distribution shifts across domains such as medicine and ecology. Not applicable (entity) · unknown · unknown resource · en - ### [Windows Agent Arena](/evaluation/benchmarks-and-leaderboards/windows-agent-arena/index.md) Creator not supplied; see original source. Windows Agent Arena GitHub repo from Microsoft: scalable Windows OS environment for testing multimodal computer-use agents. Not applicable (entity) · unknown · unknown resource · en - ### [WorkArena](/evaluation/benchmarks-and-leaderboards/workarena/index.md) Creator not supplied; see original source. ServiceNow WorkArena GitHub repo: benchmark of web agents on common enterprise knowledge-work tasks. Not applicable (entity) · unknown · unknown resource · en - ### [WorldLens](/evaluation/benchmarks-and-leaderboards/worldlens/index.md) Creator not supplied; see original source. WorldLens GitHub repo (CVPR 2026): evaluations of driving world models across generation and reconstruction. Not applicable (entity) · unknown · unknown resource · en - ### [WorldScore](/evaluation/benchmarks-and-leaderboards/worldscore/index.md) Creator not supplied; see original source. WorldScore project page: unified benchmark for 3D, 4D and video world generation on controllability, quality and dynamics. Not applicable (entity) · unknown · unknown resource · en - ### [WorldScore Leaderboard (Hugging Face Space)](/evaluation/benchmarks-and-leaderboards/worldscore-leaderboard-hf/index.md) Creator not supplied; see original source. WorldScore leaderboard Space: current model rankings on the WorldScore world-generation benchmark. Not applicable (entity) · unknown · unknown resource · en - ### [ZeroBench](/evaluation/benchmarks-and-leaderboards/zerobench/index.md) Creator not supplied; see original source. ZeroBench project page: visual reasoning benchmark designed so current multimodal models score near zero. Not applicable (entity) · unknown · unknown resource · en - ### [Zindi](/evaluation/benchmarks-and-leaderboards/zindi/index.md) Creator not supplied; see original source. Zindi: competition platform hosting data-science and AI challenges with datasets and metrics, focused on Africa. Not applicable (entity) · unknown · unknown resource · en - ### [ChinAI #315: Abandoned? Checking in on Three Key AI Safety Benchmarks](/evaluation/benchmarks-and-leaderboards/chinai-315-abandoned-check-on-chinese-safety-benchmarks/index.md) Creator not supplied; see original source. ChinAI newsletter issue checking whether three Chinese AI safety benchmarks are still maintained. Beginner–Expert · unknown · unknown resource · en - ### [ChinAI #351: CAICT launches 2026 AI Safety Evaluations](/evaluation/benchmarks-and-leaderboards/chinai-351-caict-2026-ai-safety-evaluations/index.md) Creator not supplied; see original source. ChinAI newsletter issue 351 on CAICT's 2026 AI safety evaluations and lessons from its 2025 assessments. Beginner–Expert · unknown · unknown resource · en - ### [Your AI Product Needs Evals (Hamel Husain)](/evaluation/benchmarks-and-leaderboards/evals-verification/index.md) Creator not supplied; see original source. Hamel Husain's essay on building domain-specific evaluation systems for LLM products. Beginner–Intermediate · unknown · unknown resource · en - ### [FLI AI Safety Index Summer 2026 (PDF)](/evaluation/benchmarks-and-leaderboards/fli-ai-safety-index-summer-2026-pdf/index.md) Creator not supplied; see original source. Future of Life Institute AI Safety Index Summer 2026 full report (PDF) with company grades by domain. Beginner–Expert · unknown · unknown resource · en - ### [What matters when evaluating AI agents for customer service (Intercom)](/evaluation/benchmarks-and-leaderboards/intercom-what-really-matters-when-evaluating-ai-agents-for-cs/index.md) Creator not supplied; see original source. Intercom post on criteria beyond performance for evaluating AI agents for customer service. Beginner · unknown · unknown resource · en [Previous page](/evaluation/page/12/index.md) [Next page](/evaluation/page/14/index.md) [Plain-text Markdown copy](/evaluation/page/13/index.md)