--- id: "/safety-security-interpretability/security-red-teaming/page/2/" title: "security & red-teaming: 51 curated resources · page 2" url: "https://skillissue.dev/safety-security-interpretability/security-red-teaming/page/2/" --- # security & red-teaming: 51 curated resources security & red-teaming [Beginner](/safety-security-interpretability/beginner/index.md) [Intermediate](/safety-security-interpretability/intermediate/index.md) [Advanced](/safety-security-interpretability/advanced/index.md) [Expert](/safety-security-interpretability/expert/index.md) 51 resources · page 2 of 2 - ### [NIST AI 100-2 Adversarial ML taxonomy](/security-and-red-teaming/safety-and-alignment-evals/nist-ai-100-2-adversarial-ml-taxonomy/index.md) by [NIST](https://nist.gov/) NIST AI 100-2 report: taxonomy and terminology of adversarial machine learning attacks and mitigations. Intermediate–Advanced learning_resource docs US en - ### [OWASP Top 10 for Agentic Applications 2026](/security-and-red-teaming/safety-and-alignment-evals/owasp-top-10-for-agentic-applications-2026/index.md) by [OWASP Gen AI Security Project](https://genai.owasp.org/) OWASP Top 10 for Agentic Applications 2026: list of security risks specific to AI agents. Intermediate learning_resource guide Global en - ### [From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code](/security-and-red-teaming/safety-and-alignment-evals/project-zero-from-naptime-to-big-sleep/index.md) by [Google Project Zero](https://projectzero.google/) Google Project Zero post on Big Sleep, an LLM agent that found an exploitable SQLite vulnerability in real code. Intermediate learning_resource guide US en - ### [promptfoo docs: OWASP LLM Top 10 red teaming](/security-and-red-teaming/safety-and-alignment-evals/promptfoo-owasp-llm-top-10-red-teaming/index.md) by [promptfoo](https://promptfoo.dev) Promptfoo documentation mapping its red-teaming plugins to the OWASP LLM Top 10 risks. Intermediate learning_resource guide US en - ### [Red Teaming LMs to Reduce Harms (Ganguli et al.)](/security-and-red-teaming/safety-and-alignment-evals/red-teaming-lms-to-reduce-harms-ganguli-et-al/index.md) by [Deep Ganguli et al. (Anthropic)](https://www.anthropic.com/) arXiv paper (2022) by Anthropic on red teaming language models: methods, scaling behaviour and a released attack dataset. Intermediate learning_resource paper US en - ### [Redwood Research](/security-and-red-teaming/safety-and-alignment-evals/redwood-research/index.md) by [Redwood Research](https://redwoodresearch.org/) Redwood Research page listing its research on AI control and keeping AI systems aligned with developer intent. Intermediate–Advanced learning_resource docs US en - ### [Simon Willison on prompt-injection](/security-and-red-teaming/safety-and-alignment-evals/simon-willison-prompt-injection-tag/index.md) by [Simon Willison](https://simonwillison.net/) Simon Willison's prompt-injection tag: running record of prompt-injection attacks and incidents since 2022. Intermediate learning_resource guide UK/US en - ### [The lethal trifecta for AI agents (Simon Willison)](/security-and-red-teaming/safety-and-alignment-evals/simon-willison-the-lethal-trifecta/index.md) by [Simon Willison](https://simonwillison.net/) Simon Willison's post on the lethal trifecta: private data, untrusted content and exfiltration make AI agents exploitable. Intermediate learning_resource guide UK/US en - ### [AIxCC finals: Tale of the tape (Trail of Bits)](/security-and-red-teaming/safety-and-alignment-evals/trail-of-bits-aixcc-finals-tale-of-the-tape/index.md) by [Trail of Bits](https://www.trailofbits.com/) Trail of Bits analysis comparing the cyber reasoning system designs of DARPA AIxCC finalists. Intermediate learning_resource guide US en - ### [vLLM docs: Security](/security-and-red-teaming/safety-and-alignment-evals/vllm-security/index.md) by [vLLM](https://github.com/vllm-project) vLLM security documentation: guidance on exposing and hardening self-hosted inference servers. Intermediate learning_resource docs Global en - ### [XBOW Blog](/security-and-red-teaming/safety-and-alignment-evals/xbow-autonomous-pentest/index.md) by [XBOW](https://xbow.com/) XBOW blog with research posts on autonomous AI penetration testing, vulnerability discovery and exploit validation. Intermediate learning_resource blog US en - ### [MCP docs: Security best practices](/security-and-red-teaming/safety-and-alignment-evals/mcp-security-best-practices-2026-07-28/index.md) by [Model Context Protocol](https://modelcontextprotocol.io) MCP security best practices: mitigations for confused deputy, token passthrough and session hijacking attacks. Advanced learning_resource docs Global en - ### [Strengthening our defenses against distillation attacks](/security-and-red-teaming/safety-and-alignment-evals/strengthening-our-defenses-against-distillation-attacks/index.md) by [Anthropic](https://anthropic.com/) Anthropic research post on defending against illicit distillation of its models. Advanced learning_resource paper US en - ### [AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents](/security-and-red-teaming/safety-and-alignment-evals/agentdojo-2/index.md) by [Edoardo Debenedetti et al. (ETH Zurich)](https://ethz.ch/) arXiv paper (2024) introducing AgentDojo, an environment for evaluating prompt injection attacks and defences on tool agents. Expert learning_resource paper Switzerland en - ### [AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents](/security-and-red-teaming/safety-and-alignment-evals/agentharm-2/index.md) by [Maksym Andriushchenko et al. (Gray Swan AI and UK AI Security Institute)](https://www.grayswan.ai/) arXiv paper (2024) introducing AgentHarm, a benchmark measuring harmful task completion by LLM agents. Expert learning_resource paper UK en - ### [Defeating Prompt Injections by Design (CaMeL)](/security-and-red-teaming/safety-and-alignment-evals/camel-defeating-prompt-injections-by-design/index.md) by [Edoardo Debenedetti et al. (Google DeepMind)](https://deepmind.google/) arXiv paper (2025) by Google DeepMind introducing CaMeL, a capability-based design that defeats prompt injections. Expert learning_resource paper UK/US en - ### [Embrace The Red (Johann Rehberger)](/security-and-red-teaming/safety-and-alignment-evals/embrace-the-red-johann-rehberger/index.md) by [Johann Rehberger (Embrace The Red)](https://embracethered.com/) Embrace The Red, Johann Rehberger's blog documenting prompt-injection and data-exfiltration exploits in real AI agents and IDEs. Expert learning_resource blog US en - ### [The Instruction Hierarchy](/security-and-red-teaming/safety-and-alignment-evals/the-instruction-hierarchy/index.md) by [Eric Wallace et al. (OpenAI)](https://openai.com/) arXiv paper (2024) by OpenAI introducing the instruction hierarchy to train models to prioritise privileged instructions. Expert learning_resource paper US en - ### [Universal adversarial attacks (GCG)](/security-and-red-teaming/safety-and-alignment-evals/universal-adversarial-attacks-gcg/index.md) by [Andy Zou et al. (Carnegie Mellon University)](https://www.cmu.edu/) arXiv paper (2023) introducing GCG, universal transferable adversarial suffixes that jailbreak aligned LLMs. Expert learning_resource paper US en [Previous page](/safety-security-interpretability/security-red-teaming/index.md) [Plain-text Markdown copy](/safety-security-interpretability/security-red-teaming/page/2/index.md)