--- id: "/evaluation-benchmarks/expert/page/11/" title: "Evaluation & benchmarks for expert learners · page 11" url: "https://skillissue.dev/evaluation-benchmarks/expert/page/11/" --- # Evaluation & benchmarks for expert learners [Beginner](/evaluation-benchmarks/beginner/index.md) [Intermediate](/evaluation-benchmarks/intermediate/index.md) [Advanced](/evaluation-benchmarks/advanced/index.md) [Expert](/evaluation-benchmarks/expert/index.md) 443 resources · page 11 of 14 - ### [SALAD-Bench](/evaluation/benchmarks-and-leaderboards/salad-bench/index.md) by [OpenSafetyLab](https://github.com/OpenSafetyLab) SALAD-Bench GitHub repo: hierarchical safety benchmark of harmful questions plus the MD-Judge evaluator model. entity benchmark China [STATE] (Shanghai AI Lab per memory; page names no institution) en - ### [CRMArena](/evaluation/benchmarks-and-leaderboards/salesforce-ai-research-crmarena/index.md) by [Salesforce AI Research](https://github.com/SalesforceAIResearch) Salesforce CRMArena GitHub repo: benchmarks for LLM agents on CRM tasks (CRMArena and CRMArena-Pro). entity repo US en - ### [Сбер предложил Альянсу в сфере ИИ концепцию независимого бенчмарка (Mobile-Review)](/evaluation/benchmarks-and-leaderboards/sber-proposes-mera-to-the-alliance-press-release/index.md) by [Mobile-review.com](https://mobile-review.com/) Mobile-review press release in Russian on Sber proposing the MERA benchmark concept to Russia's AI Alliance. entity news Russia ru - ### [Scale Labs leaderboards](/evaluation/benchmarks-and-leaderboards/scale-labs-leaderboards-ex-seal/index.md) by [Scale AI](https://scale.com/) Scale Labs leaderboards: expert-built benchmarks with held-out sets across coding, reasoning, agents and safety. entity leaderboard US en - ### [Scale SEAL leaderboards](/evaluation/benchmarks-and-leaderboards/scale-seal-leaderboards/index.md) by [Scale AI](https://scale.com/) Scale leaderboards page (now Scale Labs): expert-built LLM benchmarks across coding, reasoning and more. entity leaderboard West en - ### [ScanNet benchmark](/evaluation/benchmarks-and-leaderboards/scannet-benchmark/index.md) by [ScanNet](https://github.com/ScanNet) ScanNet GitHub repo: RGB-D video dataset of 1,500+ indoor scans with 3D annotations and benchmark. entity repo US / International en - ### [SciCode](/evaluation/benchmarks-and-leaderboards/scicode/index.md) by [scicode-bench](https://github.com/scicode-bench) SciCode benchmark site: research-level scientific coding problems for evaluating language models. entity benchmark US en - ### [ScienceAgentBench](/evaluation/benchmarks-and-leaderboards/scienceagentbench/index.md) by [OSU Natural Language Processing](https://github.com/OSU-NLP-Group) ScienceAgentBench project page: data-driven scientific discovery tasks from published papers for evaluating language agents. entity benchmark US (OSU) en - ### [ScreenSpot-Pro](/evaluation/benchmarks-and-leaderboards/screenspot-pro/index.md) by [Kaixin Li](https://likaixin2000.github.io/) ScreenSpot-Pro GitHub repo: GUI grounding benchmark on high-resolution professional desktop screenshots. entity repo China / International en - ### [SEA-HELM](/evaluation/benchmarks-and-leaderboards/sea-helm/index.md) by [AI Singapore](https://aisingapore.org) SEA-HELM GitHub repo from AI Singapore: evaluation framework for LLMs on Southeast Asian languages and culture. entity benchmark Singapore; Southeast Asia en - ### [SEA-HELM leaderboard (AI Singapore)](/evaluation/benchmarks-and-leaderboards/sea-helm-leaderboard-ai-singapore/index.md) by [AI Singapore (SEA-HELM)](https://aisingapore.org/) SEA-HELM leaderboard (AI Singapore): holistic evaluation of LLMs on Southeast Asian languages. entity leaderboard SE Asia my|fil|id|ms|ta|th|vi - ### [SeaExam / LLM Leaderboard for SEA (SeaLLMs)](/evaluation/benchmarks-and-leaderboards/seaexam-llm-leaderboard-for-sea-seallms/index.md) by [SeaLLMs](https://huggingface.co/SeaLLMs) SeaLLMs SeaExam leaderboard Hugging Face Space: LLM results on Southeast Asian language exams. entity repo SE Asia mul - ### [SEED-TTS-EVAL](/evaluation/benchmarks-and-leaderboards/seed-tts-eval/index.md) by [BytedanceSpeech](https://github.com/BytedanceSpeech) ByteDance seed-tts-eval GitHub repo: objective test set and scripts for evaluating TTS models. entity repo China en - ### [Shaastra (IIT-M): "Marking benchmarks"](/evaluation/benchmarks-and-leaderboards/shaastra-iit-m-marking-benchmarks/index.md) by [Shaastra (IIT Madras)](https://shaastramag.iitm.ac.in/) IIT Madras Shaastra feature on rethinking AI evaluation for real-world deployment, including Indic benchmarks. entity news India en - ### [SILMA Arabic Broad Leaderboard](/evaluation/benchmarks-and-leaderboards/silma-arabic-broad-leaderboard/index.md) by [SILMA AI](https://huggingface.co/silma-ai) SILMA Arabic Broad Leaderboard Hugging Face Space: model results on a broad Arabic benchmark. entity repo MENA ar - ### [SimpleBench](/evaluation/benchmarks-and-leaderboards/simplebench/index.md) by [SimpleBench (Philip, AI Explained)](https://simple-bench.com/) SimpleBench site: multiple-choice benchmark of questions that ordinary humans answer easily but LLMs often miss, with a human baseline. entity benchmark UK (indie) en - ### [SimpleQA (simple-evals)](/evaluation/benchmarks-and-leaderboards/simpleqa-simple-evals/index.md) by [OpenAI](https://openai.com/) OpenAI simple-evals GitHub repo: reference implementations of evals such as SimpleQA, HealthBench and BrowseComp. entity benchmark US en - ### [SimpleQA Verified](/evaluation/benchmarks-and-leaderboards/simpleqa-verified/index.md) by [Lukas Haas et al. (Google)](https://ai.google/) SimpleQA Verified paper: a cleaned 1,000-prompt version of SimpleQA for measuring short-form factual recall of LLMs. entity benchmark US (GDM) en - ### [SimplerEnv (SIMPLER)](/evaluation/benchmarks-and-leaderboards/simplerenv-simpler/index.md) by [simple-env](https://github.com/simpler-env) SimplerEnv project page: simulated environments for evaluating real-world robot manipulation policies such as Google Robot and WidowX. entity benchmark US (UCSD, Stanford, Berkeley, Google DeepMind) en - ### [Singapore AISI (Digital Trust Centre)](/evaluation/benchmarks-and-leaderboards/singapore-aisi-digital-trust-centre/index.md) by [Singapore AI Safety Institute](https://www.sgaisi.sg/) Singapore AI Safety Institute (Digital Trust Centre): research on AI safety science and governance. entity org Singapore en - ### [SongBench](/evaluation/benchmarks-and-leaderboards/songbench/index.md) by [Tencent](https://opensource.tencent.com) Tencent SongBench GitHub repo: benchmark evaluating AI-generated songs across multiple musical dimensions. entity repo China en - ### [SongEval](/evaluation/benchmarks-and-leaderboards/songeval/index.md) by [ASLP-lab](https://github.com/ASLP-lab) SongEval GitHub repo: song aesthetic evaluation toolkit and dataset. entity repo China en - ### [Spider 2.0](/evaluation/benchmarks-and-leaderboards/spider-2-0/index.md) by [spider2-sql](https://github.com/spider2-sql) Spider 2.0 site: 632 enterprise text-to-SQL workflow problems for evaluating language models and agents. entity benchmark US / International en - ### [Spiral-Bench (EQ-Bench)](/evaluation/benchmarks-and-leaderboards/spiral-bench-eq-bench/index.md) by [Sam Paech (EQ-Bench)](https://eqbench.com/) EQ-Bench Spiral-Bench leaderboard, scoring how models handle simulated users drifting into delusional or harmful spirals. entity benchmark Independent (Sam Paech) en - ### [Stanford HAI/RegLab: legal models hallucinate in 1 of 6+ queries](/evaluation/benchmarks-and-leaderboards/stanford-hai-reglab-legal-models-hallucinate-in-1-of-6-queries/index.md) by [Stanford HAI](https://hai.stanford.edu/) Stanford HAI article on a RegLab study measuring hallucination rates of legal AI research tools such as Lexis+ AI and Westlaw AI. entity benchmark US en - ### [StrongREJECT](/evaluation/benchmarks-and-leaderboards/strongreject/index.md) by [StrongREJECT team (UC Berkeley)](https://github.com/dsbowen/strong_reject) StrongREJECT documentation: benchmark package that scores whether jailbreaks yield useful harmful outputs rather than mere compliance. entity benchmark US / International en - ### [SuperCLUE](/evaluation/benchmarks-and-leaderboards/superclue/index.md) by [SuperCLUE (CLUE benchmark team)](https://www.superclueai.com/) SuperCLUE: Chinese LLM benchmark with general, reasoning, multimodal, agent and application leaderboards. entity leaderboard CN zh - ### [SuperCLUE GitHub](/evaluation/benchmarks-and-leaderboards/superclue-github/index.md) by [CLUE benchmark](https://www.CLUEbenchmarks.com) SuperCLUE GitHub repo: Chinese general foundation model benchmark with methodology and results. entity repo China zh - ### [SuperCLUE-Safety](/evaluation/benchmarks-and-leaderboards/superclue-safety/index.md) by [CLUE benchmark](https://www.CLUEbenchmarks.com) SuperCLUE-Safety GitHub repo: a multi-turn adversarial safety benchmark for Chinese large language models. entity benchmark China zh - ### [SuperGLUE](/evaluation/benchmarks-and-leaderboards/superglue/index.md) by [SuperGLUE team (NYU, Facebook AI, University of Washington and DeepMind)](https://super.gluebenchmark.com/) SuperGLUE benchmark site: harder successor to GLUE with language-understanding tasks, toolkit and leaderboard. entity benchmark US / International en - ### [SWE-bench](/evaluation/benchmarks-and-leaderboards/swe-bench/index.md) by [SWE-bench team (Princeton University and Stanford University)](https://www.swebench.com/) SWE-bench leaderboards: coding-agent results on resolving real GitHub issues, across SWE-bench Verified, Multilingual and Multimodal. entity leaderboard West en - ### [SWE-bench Pro](/evaluation/benchmarks-and-leaderboards/swe-bench-pro/index.md) by [Scale](https://scale.com) Scale AI SWE-bench Pro GitHub repo: benchmark of long-horizon software engineering tasks for agents. entity repo US en [Previous page](/evaluation-benchmarks/expert/page/10/index.md) [Next page](/evaluation-benchmarks/expert/page/12/index.md) [Plain-text Markdown copy](/evaluation-benchmarks/expert/page/11/index.md)