---
id: "chao-jailbreakbench"
title: "JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models"
creator: "Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko and colleagues"
creator_url: "https://arxiv.org/abs/2404.01318v5"
creator_x: null
url: "https://arxiv.org/abs/2404.01318v5"
level: "advanced"
level_max: null
category: "security-and-red-teaming"
subcategory: "jailbreak-research"
region: "West"
license: "closed"
license_scope: "linked-resource"
access: "free"
models: ["model-agnostic"]
source_date: "2024-03-28"
date_added: "2026-10-18"
---

[Jailbreaking and red teaming](/security-and-red-teaming/index.md)

# JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models

by [Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko and colleagues](https://arxiv.org/abs/2404.01318v5)

[Read the original →](https://arxiv.org/abs/2404.01318v5)

Learn why jailbreak studies need consistent threat models, scoring and reproducible comparisons.

JailbreakBench proposes a standardized framework for comparing language-model jailbreak attacks and defenses. The paper explains reproducibility and evaluation conventions; this index links the research without reproducing attack prompts.

Level: [Advanced](/levels/index.md#advanced)
Models: model-agnostic
Category: [Jailbreaking and red teaming](/security-and-red-teaming/index.md)
Tags: [primary-source](/tags/primary-source/index.md), [jailbreak-research](/tags/jailbreak-research/index.md)
Source date: 2024-03-28
Added: 2026-10-18
Last verified: 2026-10-18
Status: ok
Prerequisites: Assumes knowledge of LLM safety evaluation, threat models and experimental comparisons.
Subcategory: [jailbreak research](/security-and-red-teaming/jailbreak-research/index.md)
Region: West
Original language: en
Access: free
Resource reuse: closed: The inspected paper states the arXiv perpetual non-exclusive distribution license, not a general open-reuse grant. The benchmark code’s separate license is not transferred to this linked paper. [Facet definitions](/about/index.md#facets)

Summary in our own words. Rights remain with the original creator. [Credit and correction policy](/about/index.md#credit-policy).

[Plain-text Markdown copy](/security-and-red-teaming/jailbreak-research/chao-jailbreakbench/index.md)