--- id: "/evaluation/page/9/" title: "Evaluation · page 9" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/evaluation/page/9/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Evaluation Measure model capabilities and application behavior with explicit criteria. - [Benchmarks And Leaderboards](/evaluation/benchmarks-and-leaderboards/index.md) (512) - [Eval Harnesses](/evaluation/eval-harnesses/index.md) (3) - [Application Evals](/evaluation/application-evals/index.md) (2) - [Llm As Judge](/evaluation/llm-as-judge/index.md) (1) - [Agent Evals](/evaluation/agent-evals/index.md) (1) [Beginner](/evaluation/beginner/index.md) [Intermediate](/evaluation/intermediate/index.md) [Advanced](/evaluation/advanced/index.md) [Expert](/evaluation/expert/index.md) 519 resources · page 9 of 17 - ### [NAVSIM v2 navhard leaderboard](/evaluation/benchmarks-and-leaderboards/navsim-v2-navhard-leaderboard/index.md) Creator not supplied; see original source. NAVSIM v2 navhard leaderboard Space: public leaderboard for end-to-end autonomous driving planning. Not applicable (entity) · unknown · unknown resource · en - ### [Nejumi / Japanese LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/nejumi-japanese-llm-leaderboard/index.md) Creator not supplied; see original source. W&B llm-leaderboard GitHub repo: code and methodology for the Nejumi Leaderboard, which evaluates LLMs on Japanese tasks. Not applicable (entity) · unknown · unknown resource · ja - ### [Nejumi LLM Leaderboard 4](/evaluation/benchmarks-and-leaderboards/nejumi-llm-leaderboard-4/index.md) Creator not supplied; see original source. Nejumi LLM Leaderboard 4 report (Weights & Biases Japan, now on CoreWeave Forge): evaluation of LLMs on Japanese tasks. Not applicable (entity) · unknown · unknown resource · ja - ### [NIST CAISI](/evaluation/benchmarks-and-leaderboards/nist-caisi/index.md) Creator not supplied; see original source. NIST CAISI: US government center evaluating AI models and developing measurement standards. Not applicable (entity) · unknown · unknown resource · en - ### [NoLiMa](/evaluation/benchmarks-and-leaderboards/nolima/index.md) Creator not supplied; see original source. NoLiMa paper: a long-context benchmark where the needle must be found without literal word overlap with the question. Not applicable (entity) · unknown · unknown resource · en - ### [nuScenes](/evaluation/benchmarks-and-leaderboards/nuscenes/index.md) Creator not supplied; see original source. nuScenes site: autonomous-driving dataset with camera, lidar and radar data plus detection, tracking and prediction benchmarks. Not applicable (entity) · unknown · unknown resource · en - ### [nuScenes leaderboards](/evaluation/benchmarks-and-leaderboards/nuscenes-leaderboards/index.md) Creator not supplied; see original source. nuScenes leaderboards: autonomous-driving benchmarks for detection, tracking, prediction and planning. Not applicable (entity) · unknown · unknown resource · en - ### [OALL Hugging Face organization](/evaluation/benchmarks-and-leaderboards/oall-open-arabic-llm-leaderboard-hf-org/index.md) Creator not supplied; see original source. Open Arabic LLM Leaderboard (OALL) Hugging Face organisation: evaluation of Arabic language models. Not applicable (entity) · unknown · unknown resource · ar - ### [ObjectNet](/evaluation/benchmarks-and-leaderboards/objectnet/index.md) Creator not supplied; see original source. ObjectNet site: real-world object recognition test set with controlled backgrounds, rotations and viewpoints. Not applicable (entity) · unknown · unknown resource · en - ### [OCRBench](/evaluation/benchmarks-and-leaderboards/ocrbench/index.md) Creator not supplied; see original source. MultimodalOCR GitHub repo: OCRBench evaluation of text recognition in large multimodal models. Not applicable (entity) · unknown · unknown resource · en - ### [OCRBench v2 leaderboard](/evaluation/benchmarks-and-leaderboards/ocrbench-v2-leaderboard/index.md) Creator not supplied; see original source. OCRBench v2 leaderboard: scores of multimodal models on visual text localisation and reasoning tasks. Not applicable (entity) · unknown · unknown resource · en - ### [olmOCR-Bench](/evaluation/benchmarks-and-leaderboards/olmocr-bench/index.md) Creator not supplied; see original source. olmOCR GitHub repo from Ai2: PDF linearisation toolkit that includes olmOCR-Bench, unit-test cases for OCR quality. Not applicable (entity) · unknown · unknown resource · en - ### [OmniDocBench](/evaluation/benchmarks-and-leaderboards/omnidocbench/index.md) Creator not supplied; see original source. OmniDocBench GitHub repo: benchmark for document parsing covering layout, tables, formulas and OCR across document types. Not applicable (entity) · unknown · unknown resource · zh - ### [Open ASR Leaderboard](/evaluation/benchmarks-and-leaderboards/open-asr-leaderboard/index.md) Creator not supplied; see original source. Hugging Face Open ASR Leaderboard: word error rate and speed of speech recognition models on public datasets. Not applicable (entity) · unknown · unknown resource · en|mul - ### [Open Catalyst Project](/evaluation/benchmarks-and-leaderboards/open-catalyst-project/index.md) Creator not supplied; see original source. Open Catalyst Project site: atomistic datasets, models and challenges for AI-based catalyst discovery. Not applicable (entity) · unknown · unknown resource · en - ### [Open Graph Benchmark](/evaluation/benchmarks-and-leaderboards/open-graph-benchmark/index.md) Creator not supplied; see original source. Open Graph Benchmark site from Stanford: graph datasets, data loaders and evaluators for graph machine learning. Not applicable (entity) · unknown · unknown resource · en - ### [Open ITA LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/open-ita-llm-leaderboard/index.md) Creator not supplied; see original source. Open Ita LLM Leaderboard Hugging Face Space: filterable results of models on Italian benchmarks. Not applicable (entity) · unknown · unknown resource · it - ### [Open Ko-LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/open-ko-llm-leaderboard/index.md) Creator not supplied; see original source. Upstage Open Ko-LLM Leaderboard Space on Hugging Face for comparing language models on Korean benchmarks. Not applicable (entity) · unknown · unknown resource · ko - ### [Open LLM French Leaderboard](/evaluation/benchmarks-and-leaderboards/open-llm-french-leaderboard/index.md) Creator not supplied; see original source. Open LLM French Leaderboard Hugging Face Space: filterable results of models on French benchmarks. Not applicable (entity) · unknown · unknown resource · fr - ### [Open LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/open-llm-leaderboard-archived/index.md) Creator not supplied; see original source. Open LLM Leaderboard Space (archived): historical scores of open language models filterable by size. Not applicable (entity) · unknown · unknown resource · en - ### [Open LLM Turkish Leaderboard v0.2](/evaluation/benchmarks-and-leaderboards/open-llm-turkish-leaderboard-v0-2/index.md) Creator not supplied; see original source. Open LLM Turkish Leaderboard v0.2 Hugging Face Space: filterable results of models on Turkish benchmarks. Not applicable (entity) · unknown · unknown resource · tr - ### [Open Persian LLM Leaderboard org readme](/evaluation/benchmarks-and-leaderboards/open-persian-llm-leaderboard-org-readme/index.md) Creator not supplied; see original source. Open Persian LLM Leaderboard organisation readme describing the Amirkabir University-led initiative. Not applicable (entity) · unknown · unknown resource · fa - ### [Open Persian LLM Leaderboard (PartAI)](/evaluation/benchmarks-and-leaderboards/open-persian-llm-leaderboard-partai/index.md) Creator not supplied; see original source. PartAI Open Persian LLM Leaderboard Hugging Face Space: comparison of models on Persian benchmarks. Not applicable (entity) · unknown · unknown resource · fa - ### [Open PL LLM Leaderboard (SpeakLeash)](/evaluation/benchmarks-and-leaderboards/open-pl-llm-leaderboard-speakleash/index.md) Creator not supplied; see original source. SpeakLeash Open PL LLM Leaderboard Hugging Face Space: detailed results of models on Polish tasks. Not applicable (entity) · unknown · unknown resource · pl - ### [Open Portuguese LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/open-portuguese-llm-leaderboard-archived/index.md) Creator not supplied; see original source. Open Portuguese LLM Leaderboard Hugging Face Space (archived): past results of models on Portuguese benchmarks. Not applicable (entity) · unknown · unknown resource · pt - ### [Open VLM Leaderboard (OpenCompass)](/evaluation/benchmarks-and-leaderboards/open-vlm-leaderboard-opencompass/index.md) Creator not supplied; see original source. OpenCompass Open VLM Leaderboard Space: vision-language model results aggregated from VLMEvalKit benchmarks. Not applicable (entity) · unknown · unknown resource · en|zh - ### [OpenAI Evals](/evaluation/benchmarks-and-leaderboards/openai-evals/index.md) Creator not supplied; see original source. OpenAI Evals GitHub repo: framework and registry for evaluating LLMs and LLM systems. Not applicable (entity) · unknown · unknown resource · en - ### [frontier-evals](/evaluation/benchmarks-and-leaderboards/openai-frontier-evals-paperbench-etc/index.md) Creator not supplied; see original source. OpenAI frontier-evals GitHub repo: code for evaluations such as PaperBench and SWE-Lancer. Not applicable (entity) · unknown · unknown resource · en - ### [OpenAI MRCR](/evaluation/benchmarks-and-leaderboards/openai-mrcr/index.md) Creator not supplied; see original source. OpenAI MRCR dataset: multi-round coreference resolution task for testing long-context retrieval, as reported in model cards. Not applicable (entity) · unknown · unknown resource · en - ### [OpenCompass 司南](/evaluation/benchmarks-and-leaderboards/opencompass/index.md) Creator not supplied; see original source. OpenCompass leaderboard in Chinese: scores and rankings of language and multimodal models across ability dimensions. Not applicable (entity) · unknown · unknown resource · en - ### [OpenCompass](/evaluation/benchmarks-and-leaderboards/opencompass-2/index.md) Creator not supplied; see original source. OpenCompass GitHub repo: LLM evaluation platform with configs for many datasets, inference, judging and leaderboards. Not applicable (entity) · unknown · unknown resource · zh - ### [OpenCompass CompassRank: Multimodal Leaderboard](/evaluation/benchmarks-and-leaderboards/opencompass-compassrank-multimodal/index.md) Creator not supplied; see original source. OpenCompass CompassRank multimodal leaderboard: scores of vision-language models across benchmarks. Not applicable (entity) · unknown · unknown resource · zh [Previous page](/evaluation/page/8/index.md) [Next page](/evaluation/page/10/index.md) [Plain-text Markdown copy](/evaluation/page/9/index.md)