--- id: "/tags/security-red-teaming/" title: "Security Red Teaming" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/tags/security-red-teaming/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Security Red Teaming [Beginner](/levels/beginner/index.md) [Intermediate](/levels/intermediate/index.md) [Advanced](/levels/advanced/index.md) [Expert](/levels/expert/index.md) 51 resources · page 1 of 2 - ### [AIxCC Competition Archive](/security-and-red-teaming/safety-and-alignment-evals/aixcc-archive-all-finalist-crs-repos/index.md) Creator not supplied; see original source. AIxCC Competition Archive: DARPA AI Cyber Challenge records and code of finalist cyber reasoning systems. Not applicable (entity) · unknown · unknown resource · en - ### [Georgia Tech: AIxCC lessons at USENIX Security 2026](/security-and-red-teaming/safety-and-alignment-evals/georgia-tech-aixcc-lessons-at-usenix-security-2026/index.md) Creator not supplied; see original source. Georgia Tech news on its researchers' AI Cyber Challenge (AIxCC) lessons presented at USENIX Security 2026. Not applicable (entity) · unknown · unknown resource · en - ### [Haize Labs](/security-and-red-teaming/safety-and-alignment-evals/haize-labs/index.md) Creator not supplied; see original source. Haize Labs: company providing red-teaming and evaluation services to move AI systems into production. Not applicable (entity) · unknown · unknown resource · en - ### [IBBIS (International Biosecurity and Biosafety Initiative for Science)](/security-and-red-teaming/safety-and-alignment-evals/ibbis-international-biosecurity-and-biosafety-initiative-for-science/index.md) Creator not supplied; see original source. IBBIS: international initiative strengthening biosecurity norms and tools such as DNA synthesis screening. Not applicable (entity) · unknown · unknown resource · en - ### [agent-scan (Snyk, formerly mcp-scan)](/security-and-red-teaming/safety-and-alignment-evals/invariant-labs-mcp-scan/index.md) Creator not supplied; see original source. mcp-scan GitHub repo, now Snyk agent-scan: security scanner for AI agents, MCP servers and agent skills. Not applicable (entity) · unknown · unknown resource · en - ### [L1B3RT4S (Pliny jailbreak prompts)](/security-and-red-teaming/safety-and-alignment-evals/l1b3rt4s-pliny-jailbreak-prompts/index.md) Creator not supplied; see original source. L1B3RT4S GitHub repo (Pliny): collection of jailbreak prompts for many AI models. Not applicable (entity) · unknown · unknown resource · en - ### [Meta PurpleLlama / CyberSecEval](/security-and-red-teaming/safety-and-alignment-evals/meta-purplellama-cyberseceval/index.md) Creator not supplied; see original source. Meta PurpleLlama GitHub repo with CyberSecEval and Llama Guard, tools to assess and improve LLM security. Not applicable (entity) · unknown · unknown resource · en - ### [NVIDIA/NemoClaw](/security-and-red-teaming/safety-and-alignment-evals/nvidia-nemoclaw/index.md) Creator not supplied; see original source. NVIDIA NemoClaw GitHub repo: runtime for running agents such as Hermes, Deep Agents and OpenClaw. Not applicable (entity) · unknown · unknown resource · en - ### [NYU CTF Bench](/security-and-red-teaming/safety-and-alignment-evals/nyu-ctf-bench/index.md) Creator not supplied; see original source. NYU CTF Bench GitHub repo: capture-the-flag challenges from CSAW competitions for evaluating LLM agents on security tasks. Not applicable (entity) · unknown · unknown resource · en - ### [promptfoo](/security-and-red-teaming/safety-and-alignment-evals/promptfoo/index.md) Creator not supplied; see original source. promptfoo GitHub repo: CLI for testing prompts, agents and RAG, with red teaming. Not applicable (entity) · unknown · unknown resource · en - ### [PyRIT](/security-and-red-teaming/safety-and-alignment-evals/pyrit/index.md) Creator not supplied; see original source. Microsoft PyRIT GitHub repo: Python Risk Identification Tool for automated red teaming of generative AI. Not applicable (entity) · unknown · unknown resource · en - ### [Team Atlanta "Atlantis" CRS (finals)](/security-and-red-teaming/safety-and-alignment-evals/team-atlanta-atlantis-crs-finals/index.md) Creator not supplied; see original source. Team Atlanta Atlantis GitHub repo: cyber reasoning system from the DARPA AIxCC finals for automated vulnerability repair. Not applicable (entity) · unknown · unknown resource · en - ### [tldrsec prompt-injection-defenses](/security-and-red-teaming/safety-and-alignment-evals/tldrsec-prompt-injection-defenses/index.md) Creator not supplied; see original source. tldrsec prompt-injection-defenses GitHub repo: catalogue of practical and proposed prompt injection defences. Not applicable (entity) · unknown · unknown resource · en - ### [Trail of Bits "Buttercup" CRS (finals)](/security-and-red-teaming/safety-and-alignment-evals/trail-of-bits-buttercup-crs-finals/index.md) Creator not supplied; see original source. Trail of Bits Buttercup GitHub repo: cyber reasoning system submitted to the DARPA AIxCC finals. Not applicable (entity) · unknown · unknown resource · en - ### [Lovable docs: Security overview](/security-and-red-teaming/safety-and-alignment-evals/lovable-security-overview/index.md) Creator not supplied; see original source. Lovable security overview: built-in security scans, API key protection, database access checks and dependency audits. Beginner · unknown · unknown resource · en - ### [OWASP Top 10 for LLM Applications](/security-and-red-teaming/safety-and-alignment-evals/owasp-top-10-for-llm-applications/index.md) Creator not supplied; see original source. OWASP Top 10 for LLM Applications 2026: community list of security risks in LLM-powered applications with mitigations. Beginner–Intermediate · unknown · unknown resource · en - ### [Zed docs: AI privacy and security](/security-and-red-teaming/safety-and-alignment-evals/zed-ai-privacy-and-security/index.md) Creator not supplied; see original source. Zed documentation on AI privacy and security: what data leaves the machine when using AI features. Beginner · unknown · unknown resource · en - ### [AI security / prompt injection](/security-and-red-teaming/safety-and-alignment-evals/ai-security-prompt-injection/index.md) Creator not supplied; see original source. OWASP Gen AI Security Project archive of Top 10 risk lists for LLM applications. Intermediate · unknown · unknown resource · en - ### [Beyond permission prompts (sandboxing)](/security-and-red-teaming/safety-and-alignment-evals/beyond-permission-prompts-sandboxing/index.md) Creator not supplied; see original source. Anthropic engineering post on Claude Code's filesystem and network sandboxing to reduce permission prompts. Intermediate · unknown · unknown resource · en - ### [BSI Künstliche Intelligenz](/security-and-red-teaming/safety-and-alignment-evals/bsi-k-nstliche-intelligenz/index.md) Creator not supplied; see original source. German Federal Office for Information Security (BSI) AI page with security guidance and publications on AI systems. Intermediate · unknown · unknown resource · en|de - ### [Constitutional Classifiers](/security-and-red-teaming/safety-and-alignment-evals/constitutional-classifiers/index.md) Creator not supplied; see original source. Anthropic research post on Constitutional Classifiers, a method for defending LLMs against universal jailbreaks. Intermediate · unknown · unknown resource · en - ### [Giskard documentation](/security-and-red-teaming/safety-and-alignment-evals/giskard-documentation/index.md) Creator not supplied; see original source. Giskard documentation: open-source library and platform for testing, evaluating and red-teaming LLM agents. Intermediate · unknown · unknown resource · en - ### [Google SAIF](/security-and-red-teaming/safety-and-alignment-evals/google-saif/index.md) Creator not supplied; see original source. Google Secure AI Framework (SAIF): six core elements for AI model security, risk management and privacy. Intermediate · unknown · unknown resource · en - ### [Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection](/security-and-red-teaming/safety-and-alignment-evals/greshake-et-al-indirect-prompt-injection/index.md) Creator not supplied; see original source. arXiv paper (2023) by Greshake et al. introducing indirect prompt injection against LLM-integrated applications. Intermediate · unknown · unknown resource · en - ### [Hermes Agent docs: Security](/security-and-red-teaming/safety-and-alignment-evals/hermes-agent-security/index.md) Creator not supplied; see original source. Hermes Agent security documentation: command approval, user authorisation, container isolation and deployment practices. Intermediate · unknown · unknown resource · en - ### [HiddenLayer research](/security-and-red-teaming/safety-and-alignment-evals/hiddenlayer-research/index.md) Creator not supplied; see original source. HiddenLayer research page publishing findings on AI vulnerabilities, adversarial attacks and model security threats. Intermediate · unknown · unknown resource · en - ### [Artificial Intelligence (AI): Guidance for Judicial Office Holders](/security-and-red-teaming/safety-and-alignment-evals/judicial-office-holders-ai-guidance-october-2025/index.md) Creator not supplied; see original source. UK Judiciary guidance (PDF, October 2025) for judicial office holders on AI use cases, risks and verification duties. Intermediate · unknown · unknown resource · en - ### [Lakera blog](/security-and-red-teaming/safety-and-alignment-evals/lakera-blog/index.md) Creator not supplied; see original source. Lakera blog on AI security, prompt injection and LLM attacks, with research posts and product news. Intermediate · unknown · unknown resource · und - ### [Many-shot jailbreaking](/security-and-red-teaming/safety-and-alignment-evals/many-shot-jailbreaking/index.md) Creator not supplied; see original source. Anthropic research on many-shot jailbreaking, a long-context attack using many faux dialogue examples. Intermediate · unknown · unknown resource · en - ### [MCP docs: Local server security](/security-and-red-teaming/safety-and-alignment-evals/mcp-local-server-security/index.md) Creator not supplied; see original source. MCP documentation on hardening local stdio MCP servers. Intermediate · unknown · unknown resource · en - ### [MITRE ATLAS](/security-and-red-teaming/safety-and-alignment-evals/mitre-atlas/index.md) Creator not supplied; see original source. MITRE ATLAS: knowledge base and ATT&CK-style matrix of adversary tactics and techniques against AI systems. Intermediate · unknown · unknown resource · en - ### [NCSC/CISA Guidelines for secure AI system development](/security-and-red-teaming/safety-and-alignment-evals/ncsc-cisa-guidelines-for-secure-ai-system-development/index.md) Creator not supplied; see original source. UK NCSC and partner guidelines for secure AI system development across design, development, deployment and operation. Intermediate · unknown · unknown resource · en [Next page](/tags/security-red-teaming/page/2/index.md) [Plain-text Markdown copy](/tags/security-red-teaming/index.md)