--- id: "/tags/safety-efficiency-evals/" title: "Safety Efficiency Evals" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/tags/safety-efficiency-evals/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Safety Efficiency Evals [Beginner](/levels/beginner/index.md) [Intermediate](/levels/intermediate/index.md) [Advanced](/levels/advanced/index.md) [Expert](/levels/expert/index.md) 44 resources · page 1 of 2 - ### [AILuminate](/evaluation/benchmarks-and-leaderboards/ailuminate/index.md) Creator not supplied; see original source. MLCommons AILuminate benchmark that rates the safety of general-purpose chat models' responses to hazardous text prompts. Not applicable (entity) · unknown · unknown resource · en - ### [AIR-Bench 2024](/evaluation/benchmarks-and-leaderboards/air-bench-2024/index.md) Creator not supplied; see original source. AIR-Bench 2024 GitHub repo from Stanford CRFM: safety benchmark with a risk taxonomy drawn from regulations and company policies. Not applicable (entity) · unknown · unknown resource · en - ### [CAICT 2026 launch notice (WeChat)](/evaluation/benchmarks-and-leaderboards/caict-2026-launch-notice-wechat/index.md) Creator not supplied; see original source. CAICT WeChat notice in Chinese announcing its 2026 AI evaluation rounds. Not applicable (entity) · unknown · unknown resource · zh - ### [Canadian Artificial Intelligence Safety Institute (CAISI)](/evaluation/benchmarks-and-leaderboards/canada-aisi-caisi/index.md) Creator not supplied; see original source. Canadian Artificial Intelligence Safety Institute page on the ISED government site. Not applicable (entity) · unknown · unknown resource · en|fr - ### [ChinAI #261: First results from CAICT's AI Safety Benchmark](/evaluation/benchmarks-and-leaderboards/chinai-261-first-caict-ai-safety-benchmark-results/index.md) Creator not supplied; see original source. ChinAI newsletter issue translating the first results of CAICT's AI Safety Benchmark for Chinese language models. Not applicable (entity) · unknown · unknown resource · en - ### [CValues](/evaluation/benchmarks-and-leaderboards/cvalues/index.md) Creator not supplied; see original source. CValues GitHub repo: benchmark and research on evaluating the values and safety of Chinese large language models. Not applicable (entity) · unknown · unknown resource · zh - ### [CyberSecEval 4](/evaluation/benchmarks-and-leaderboards/cyberseceval/index.md) Creator not supplied; see original source. Meta CyberSecEval 4 documentation: open benchmarks for cybersecurity risks and capabilities of LLMs. Not applicable (entity) · unknown · unknown resource · en - ### [FAR.AI AI Security Leaderboard](/evaluation/benchmarks-and-leaderboards/far-ai-ai-security-leaderboard/index.md) Creator not supplied; see original source. FAR.AI AI Security Leaderboard comparing model safeguards against a taxonomy of attacks with a published methodology. Not applicable (entity) · unknown · unknown resource · en - ### [AI Safety Index: Summer 2026 (Future of Life Institute)](/evaluation/benchmarks-and-leaderboards/fli-ai-safety-index-summer-2026/index.md) Creator not supplied; see original source. Future of Life Institute AI Safety Index Summer 2026: expert grades of AI companies across safety and security domains. Not applicable (entity) · unknown · unknown resource · en - ### [ForesightSafety Bench](/evaluation/benchmarks-and-leaderboards/foresightsafety-bench/index.md) Creator not supplied; see original source. ForesightSafety Bench paper: a frontier-risk evaluation framework covering agentic autonomy, AI-for-science, embodied and catastrophic risks. Not applicable (entity) · unknown · unknown resource · en - ### [HallusionBench](/evaluation/benchmarks-and-leaderboards/hallusionbench/index.md) Creator not supplied; see original source. HallusionBench GitHub repo (CVPR 2024): benchmark of language hallucination and visual illusion in VLMs. Not applicable (entity) · unknown · unknown resource · en - ### [HarmBench](/evaluation/benchmarks-and-leaderboards/harmbench/index.md) Creator not supplied; see original source. HarmBench site: standardised evaluation framework for automated red-teaming attacks and model refusal defences. Not applicable (entity) · unknown · unknown resource · en - ### [IPA press release: AI safety evaluation demonstration and environment report meeting](/evaluation/benchmarks-and-leaderboards/ipa-press-release-aisi-tf-meeting-2026-10-09/index.md) Creator not supplied; see original source. IPA press release in Japanese on a briefing about AI safety evaluation trials and its open evaluation environment. Not applicable (entity) · unknown · unknown resource · ja - ### [JailbreakBench](/evaluation/benchmarks-and-leaderboards/jailbreakbench/index.md) Creator not supplied; see original source. JailbreakBench site: benchmark and leaderboard tracking jailbreak attacks and defences on LLMs with a fixed set of behaviours. Not applicable (entity) · unknown · unknown resource · en - ### [Japan AI Safety Institute](/evaluation/benchmarks-and-leaderboards/japan-ai-safety-institute/index.md) Creator not supplied; see original source. Japan AI Safety Institute: government body developing AI safety evaluation methods, guides and standards. Not applicable (entity) · unknown · unknown resource · ja - ### [米OpenAI社とMOCを締結しました (Japan AISI)](/evaluation/benchmarks-and-leaderboards/japan-aisi-openai-moc-2026-05-29/index.md) Creator not supplied; see original source. Japan AISI announcement (May 2026): memorandum of cooperation signed with OpenAI. Not applicable (entity) · unknown · unknown resource · ja - ### [Korea AISI](/evaluation/benchmarks-and-leaderboards/korea-aisi/index.md) Creator not supplied; see original source. Korea AI Safety Institute: government institute for AI safety evaluation, research and international cooperation. Not applicable (entity) · unknown · unknown resource · ko - ### [MLCommons AILuminate](/evaluation/benchmarks-and-leaderboards/mlcommons-ailuminate/index.md) Creator not supplied; see original source. MLCommons AILuminate page: safety benchmark for general-purpose chatbots, with jailbreak and agentic tracks listed. Not applicable (entity) · unknown · unknown resource · en|fr - ### [MLPerf Client](/evaluation/benchmarks-and-leaderboards/mlperf-client/index.md) Creator not supplied; see original source. MLCommons MLPerf Client page: benchmark for LLM and AI workload performance on personal computers. Not applicable (entity) · unknown · unknown resource · en - ### [MLPerf Inference](/evaluation/benchmarks-and-leaderboards/mlperf-inference/index.md) Creator not supplied; see original source. MLCommons MLPerf Inference Datacenter results: standardised throughput and latency of AI systems across models. Not applicable (entity) · unknown · unknown resource · en - ### [MLPerf Tiny](/evaluation/benchmarks-and-leaderboards/mlperf-tiny/index.md) Creator not supplied; see original source. MLCommons MLPerf Tiny page: inference benchmark for embedded and low-power devices, with published results. Not applicable (entity) · unknown · unknown resource · en - ### [MLPerf Training](/evaluation/benchmarks-and-leaderboards/mlperf-training/index.md) Creator not supplied; see original source. MLCommons MLPerf Training page: benchmark measuring time to train models to target quality, with published results. Not applicable (entity) · unknown · unknown resource · en - ### [NIST CAISI](/evaluation/benchmarks-and-leaderboards/nist-caisi/index.md) Creator not supplied; see original source. NIST CAISI: US government center evaluating AI models and developing measurement standards. Not applicable (entity) · unknown · unknown resource · en - ### [Phare](/evaluation/benchmarks-and-leaderboards/phare/index.md) Creator not supplied; see original source. Giskard Phare site: multilingual benchmark of LLM safety and security, including hallucination, bias and harmful content. Not applicable (entity) · unknown · unknown resource · mul - ### [S-Eval](/evaluation/benchmarks-and-leaderboards/s-eval/index.md) Creator not supplied; see original source. S-Eval GitHub repo: about 220,000 safety prompts, including adversarial variants, for automated LLM safety evaluation. Not applicable (entity) · unknown · unknown resource · zh|en - ### [S-Eval leaderboard (Alibaba)](/evaluation/benchmarks-and-leaderboards/s-eval-leaderboard-alibaba/index.md) Creator not supplied; see original source. Alibaba S-Eval leaderboard in Chinese: safety evaluation rankings of large language models. Not applicable (entity) · unknown · unknown resource · zh - ### [SafetyBench](/evaluation/benchmarks-and-leaderboards/safetybench/index.md) Creator not supplied; see original source. SafetyBench GitHub repo from Tsinghua: multiple-choice safety benchmark for LLMs across seven categories, in Chinese and English. Not applicable (entity) · unknown · unknown resource · zh - ### [SALAD-Bench](/evaluation/benchmarks-and-leaderboards/salad-bench/index.md) Creator not supplied; see original source. SALAD-Bench GitHub repo: hierarchical safety benchmark of harmful questions plus the MD-Judge evaluator model. Not applicable (entity) · unknown · unknown resource · en - ### [Singapore AISI (Digital Trust Centre)](/evaluation/benchmarks-and-leaderboards/singapore-aisi-digital-trust-centre/index.md) Creator not supplied; see original source. Singapore AI Safety Institute (Digital Trust Centre): research on AI safety science and governance. Not applicable (entity) · unknown · unknown resource · en - ### [StrongREJECT](/evaluation/benchmarks-and-leaderboards/strongreject/index.md) Creator not supplied; see original source. StrongREJECT documentation: benchmark package that scores whether jailbreaks yield useful harmful outputs rather than mere compliance. Not applicable (entity) · unknown · unknown resource · en - ### [SuperCLUE-Safety](/evaluation/benchmarks-and-leaderboards/superclue-safety/index.md) Creator not supplied; see original source. SuperCLUE-Safety GitHub repo: a multi-turn adversarial safety benchmark for Chinese large language models. Not applicable (entity) · unknown · unknown resource · zh - ### [UK AI Security Institute](/evaluation/benchmarks-and-leaderboards/uk-ai-security-institute/index.md) Creator not supplied; see original source. UK AI Security Institute: government body publishing frontier AI evaluations and the Inspect evaluation framework. Not applicable (entity) · unknown · unknown resource · en [Next page](/tags/safety-efficiency-evals/page/2/index.md) [Plain-text Markdown copy](/tags/safety-efficiency-evals/index.md)