--- id: "/security-and-red-teaming/page/5/" title: "Jailbreaking and red teaming · page 5" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/security-and-red-teaming/page/5/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Jailbreaking and red teaming Published jailbreak research, safety benchmarks and defensive evaluation. Credited links and summaries only; no attack payloads. - [Prompt Injection](/security-and-red-teaming/prompt-injection/index.md) (4) - [Agent And Tool Security](/security-and-red-teaming/agent-and-tool-security/index.md) (2) - [Threat Frameworks And Standards](/security-and-red-teaming/threat-frameworks-and-standards/index.md) (3) - [Security Tooling](/security-and-red-teaming/security-tooling/index.md) (3) - [Safety And Alignment Evals](/security-and-red-teaming/safety-and-alignment-evals/index.md) (126) - [Jailbreak research](/security-and-red-teaming/jailbreak-research/index.md) (2) [Beginner](/security-and-red-teaming/beginner/index.md) [Intermediate](/security-and-red-teaming/intermediate/index.md) [Advanced](/security-and-red-teaming/advanced/index.md) [Expert](/security-and-red-teaming/expert/index.md) 140 resources · page 5 of 5 - ### [UK education generative-AI product safety standards](/security-and-red-teaming/safety-and-alignment-evals/uk-education-generative-ai-product-safety-standards/index.md) Creator not supplied; see original source. UK Department for Education generative AI product safety standards for AI tools used in education. Advanced · unknown · unknown resource · en - ### [Design Patterns for Securing LLM Agents against Prompt Injections](/security-and-red-teaming/agent-and-tool-security/willison-prompt-injection-design-patterns/index.md) by [Simon Willison](https://simonwillison.net/2025/Jun/13/prompt-injection-design-patterns/) [@simonw](https://twitter.com/simonw) Summary of a paper's defensive agent architectures. Advanced · West · closed resource · en - ### [A Mathematical Framework for Transformer Circuits](/security-and-red-teaming/safety-and-alignment-evals/a-mathematical-framework-for-transformer-circuits/index.md) Creator not supplied; see original source. Anthropic Transformer Circuits paper A Mathematical Framework for Transformer Circuits (2021). Expert · unknown · unknown resource · en - ### [AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents](/security-and-red-teaming/safety-and-alignment-evals/agentdojo-2/index.md) Creator not supplied; see original source. arXiv paper (2024) introducing AgentDojo, an environment for evaluating prompt injection attacks and defences on tool agents. Expert · unknown · unknown resource · en - ### [AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents](/security-and-red-teaming/safety-and-alignment-evals/agentharm-2/index.md) Creator not supplied; see original source. arXiv paper (2024) introducing AgentHarm, a benchmark measuring harmful task completion by LLM agents. Expert · unknown · unknown resource · en - ### [Amnesty: Xenophobic Machines (Dutch childcare benefits)](/security-and-red-teaming/safety-and-alignment-evals/amnesty-xenophobic-machines-dutch-childcare-benefits/index.md) Creator not supplied; see original source. Amnesty International report Xenophobic Machines on discriminatory algorithmic profiling in the Dutch childcare benefits scandal. Expert · unknown · unknown resource · en - ### [Defeating Prompt Injections by Design (CaMeL)](/security-and-red-teaming/safety-and-alignment-evals/camel-defeating-prompt-injections-by-design/index.md) Creator not supplied; see original source. arXiv paper (2025) by Google DeepMind introducing CaMeL, a capability-based design that defeats prompt injections. Expert · unknown · unknown resource · en - ### [Embrace The Red (Johann Rehberger)](/security-and-red-teaming/safety-and-alignment-evals/embrace-the-red-johann-rehberger/index.md) Creator not supplied; see original source. Embrace The Red, Johann Rehberger's blog documenting prompt-injection and data-exfiltration exploits in real AI agents and IDEs. Expert · unknown · unknown resource · en - ### [Emergent Misalignment](/security-and-red-teaming/safety-and-alignment-evals/emergent-misalignment/index.md) Creator not supplied; see original source. arXiv paper (2025) "Emergent Misalignment", showing narrow fine-tuning on insecure code produces broadly misaligned behaviour. Expert · unknown · unknown resource · en - ### [On the Biology of a Large Language Model](/security-and-red-teaming/safety-and-alignment-evals/on-the-biology-of-a-large-language-model/index.md) Creator not supplied; see original source. Anthropic Transformer Circuits paper On the Biology of a Large Language Model: attribution graphs on Claude 3.5 Haiku. Expert · unknown · unknown resource · en - ### [The Instruction Hierarchy](/security-and-red-teaming/safety-and-alignment-evals/the-instruction-hierarchy/index.md) Creator not supplied; see original source. arXiv paper (2024) by OpenAI introducing the instruction hierarchy to train models to prioritise privileged instructions. Expert · unknown · unknown resource · en - ### [Universal adversarial attacks (GCG)](/security-and-red-teaming/safety-and-alignment-evals/universal-adversarial-attacks-gcg/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing GCG, universal transferable adversarial suffixes that jailbreak aligned LLMs. Expert · unknown · unknown resource · en [Previous page](/security-and-red-teaming/page/4/index.md) [Plain-text Markdown copy](/security-and-red-teaming/page/5/index.md)