Security And Red Teaming
Read public research on AI threats, defenses and safety evaluation.
- Prompt Injection (3)
- Agent And Tool Security (2)
- Threat Frameworks And Standards (3)
- Security Tooling (2)
- Safety And Alignment Evals (1)
11 resources · page 1 of 1
NIST AI Risk Management Framework
by NIST
A government reference for organizing AI risk-management work.
OWASP Top 10 for LLM Applications 2025
by OWASP Gen AI Security Project
Use a shared vocabulary for discussing risks in LLM applications.
Simon Willison on prompt injection
Follow an ongoing public record of prompt-injection research.
The lethal trifecta for AI agents
A defensive framework for recognizing risky combinations of agent capabilities and untrusted inputs.
Agentic misalignment
by Anthropic
A controlled study of risky behavior under conflicting agent incentives.
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
Foundational public research on indirect prompt injection. Linked only; no payloads reproduced.
Embrace The Red
Public case reports about security failures in deployed AI products.
MITRE ATLAS
by MITRE
Connect AI threats with documented techniques, mitigations and cases.
garak - LLM vulnerability scanner
by NVIDIA
A public scanner project for understanding classes of model failures.
promptfoo
by promptfoo
Inspect a project combining application evaluation and security testing.
Design Patterns for Securing LLM Agents against Prompt Injections
Summary of a paper's defensive agent architectures.