--- id: "/security-and-red-teaming/beginner/page/2/" title: "Jailbreaking and red teaming for beginner learners · page 2" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/security-and-red-teaming/beginner/page/2/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Jailbreaking and red teaming for beginner learners [Beginner](/security-and-red-teaming/beginner/index.md) [Intermediate](/security-and-red-teaming/intermediate/index.md) [Advanced](/security-and-red-teaming/advanced/index.md) [Expert](/security-and-red-teaming/expert/index.md) 64 resources · page 2 of 2 - ### [NVIDIA/NemoClaw](/security-and-red-teaming/safety-and-alignment-evals/nvidia-nemoclaw/index.md) Creator not supplied; see original source. NVIDIA NemoClaw GitHub repo: runtime for running agents such as Hermes, Deep Agents and OpenClaw. Not applicable (entity) · unknown · unknown resource · en - ### [NYU CTF Bench](/security-and-red-teaming/safety-and-alignment-evals/nyu-ctf-bench/index.md) Creator not supplied; see original source. NYU CTF Bench GitHub repo: capture-the-flag challenges from CSAW competitions for evaluating LLM agents on security tasks. Not applicable (entity) · unknown · unknown resource · en - ### [OpenFHE](/security-and-red-teaming/safety-and-alignment-evals/openfhe/index.md) Creator not supplied; see original source. OpenFHE GitHub repo: open-source library for fully homomorphic encryption. Not applicable (entity) · unknown · unknown resource · en - ### [promptfoo](/security-and-red-teaming/safety-and-alignment-evals/promptfoo/index.md) Creator not supplied; see original source. promptfoo GitHub repo: CLI for testing prompts, agents and RAG, with red teaming. Not applicable (entity) · unknown · unknown resource · en - ### [PyRIT](/security-and-red-teaming/safety-and-alignment-evals/pyrit/index.md) Creator not supplied; see original source. Microsoft PyRIT GitHub repo: Python Risk Identification Tool for automated red teaming of generative AI. Not applicable (entity) · unknown · unknown resource · en - ### [PySyft](/security-and-red-teaming/safety-and-alignment-evals/pysyft/index.md) Creator not supplied; see original source. OpenMined PySyft GitHub repo: data science on data that stays on the owner's server, for privacy-preserving access. Not applicable (entity) · unknown · unknown resource · en - ### [SAELens](/security-and-red-teaming/safety-and-alignment-evals/saelens/index.md) Creator not supplied; see original source. SAELens GitHub repo: training and analysing sparse autoencoders on language models. Not applicable (entity) · unknown · unknown resource · en - ### [Safe Superintelligence Inc.](/security-and-red-teaming/safety-and-alignment-evals/safe-superintelligence-inc/index.md) Creator not supplied; see original source. Safe Superintelligence Inc. (SSI): company focused solely on building safe superintelligence; site has a short mission statement. Not applicable (entity) · unknown · unknown resource · en - ### [STAT: IBM Watson recommended "unsafe and incorrect" cancer treatments](/security-and-red-teaming/safety-and-alignment-evals/stat-ibm-watson-recommended-unsafe-and-incorrect-cancer-treatments/index.md) Creator not supplied; see original source. STAT report on internal IBM documents showing Watson for Oncology gave unsafe and incorrect treatment advice. Not applicable (entity) · unknown · unknown resource · en - ### [Stephenson Harwood: "Law and error"](/security-and-red-teaming/safety-and-alignment-evals/stephenson-harwood-law-and-error/index.md) Creator not supplied; see original source. Stephenson Harwood article on court scrutiny of AI tools after fictitious citations in legal filings. Not applicable (entity) · unknown · unknown resource · en - ### [Team Atlanta "Atlantis" CRS (finals)](/security-and-red-teaming/safety-and-alignment-evals/team-atlanta-atlantis-crs-finals/index.md) Creator not supplied; see original source. Team Atlanta Atlantis GitHub repo: cyber reasoning system from the DARPA AIxCC finals for automated vulnerability repair. Not applicable (entity) · unknown · unknown resource · en - ### [The Register: Figma AI accused of plagiarising Apple](/security-and-red-teaming/safety-and-alignment-evals/the-register-figma-ai-accused-of-plagiarising-apple/index.md) Creator not supplied; see original source. The Register report on Figma pulling its Make Designs AI feature after it copied Apple's Weather app. Not applicable (entity) · unknown · unknown resource · en - ### [TILOS MacroPlacement](/security-and-red-teaming/safety-and-alignment-evals/tilos-macroplacement/index.md) Creator not supplied; see original source. TILOS MacroPlacement GitHub repo: benchmarks, evaluators and an open reproduction of Google's Circuit Training for chip macro placement. Not applicable (entity) · unknown · unknown resource · en - ### [tldrsec prompt-injection-defenses](/security-and-red-teaming/safety-and-alignment-evals/tldrsec-prompt-injection-defenses/index.md) Creator not supplied; see original source. tldrsec prompt-injection-defenses GitHub repo: catalogue of practical and proposed prompt injection defences. Not applicable (entity) · unknown · unknown resource · en - ### [Trail of Bits "Buttercup" CRS (finals)](/security-and-red-teaming/safety-and-alignment-evals/trail-of-bits-buttercup-crs-finals/index.md) Creator not supplied; see original source. Trail of Bits Buttercup GitHub repo: cyber reasoning system submitted to the DARPA AIxCC finals. Not applicable (entity) · unknown · unknown resource · en - ### [TransformerLens](/security-and-red-teaming/safety-and-alignment-evals/transformerlens/index.md) Creator not supplied; see original source. TransformerLens GitHub repo: library for mechanistic interpretability of GPT-style language models. Not applicable (entity) · unknown · unknown resource · en - ### [Transluce](/security-and-red-teaming/safety-and-alignment-evals/transluce/index.md) Creator not supplied; see original source. Transluce: nonprofit lab building open tools for AI oversight and interpretability. Not applicable (entity) · unknown · unknown resource · en - ### [Waymo Safety Impact hub](/security-and-red-teaming/safety-and-alignment-evals/waymo-safety-impact-hub/index.md) Creator not supplied; see original source. Waymo Safety Impact hub: company-published crash-rate comparisons between rider-only driving miles and human benchmarks. Not applicable (entity) · unknown · unknown resource · en - ### [Anthropic Transparency Hub](/security-and-red-teaming/safety-and-alignment-evals/anthropic-transparency-hub/index.md) Creator not supplied; see original source. Anthropic Transparency Hub: system cards, model reports and voluntary commitments. Beginner–Expert · unknown · unknown resource · en - ### [BC CRT decision document (primary)](/security-and-red-teaming/safety-and-alignment-evals/bc-crt-decision-document-primary/index.md) Creator not supplied; see original source. British Columbia Civil Resolution Tribunal decision document; the tribunal decided the Moffatt v. Air Canada chatbot case. Beginner · unknown · unknown resource · en - ### [AI Agent Wipes Production Database, Then Lies About It (eWeek)](/security-and-red-teaming/safety-and-alignment-evals/eweek-ai-agent-wipes-production-database-then-lies-about-it-replit-saastr-2025-0/index.md) Creator not supplied; see original source. eWeek report on a Replit AI agent deleting a company's production database during a code freeze in a SaaStr experiment. Beginner · unknown · unknown resource · en - ### [GitHub Docs: Responsible use of Copilot agents](/security-and-red-teaming/safety-and-alignment-evals/github-docs-responsible-use-of-copilot-agents/index.md) Creator not supplied; see original source. GitHub documentation source on responsible use of Copilot agents, with stated limitations and review duties. Beginner · unknown · unknown resource · en - ### [Indirect prompt injection in the real world: how people manipulate neural networks](/security-and-red-teaming/prompt-injection/kaspersky-indirect-prompt-injection-field-study/index.md) by [Vladislav Tushkanov (Kaspersky)](https://securelist.com/indirect-prompt-injection-in-the-wild/113295/) Read a Russia-origin security team’s field study of indirect prompt injection and the implications for defensive risk assessment. Beginner · RU · closed resource · en - ### [Lovable docs: Security overview](/security-and-red-teaming/safety-and-alignment-evals/lovable-security-overview/index.md) Creator not supplied; see original source. Lovable security overview: built-in security scans, API key protection, database access checks and dependency audits. Beginner · unknown · unknown resource · en - ### [Airline Ordered To Compensate A B.C. Man Because Its Chatbot Provided Inaccurate Information (Mondaq)](/security-and-red-teaming/safety-and-alignment-evals/mondaq-moffatt-v-air-canada-2024-bccrt-149/index.md) Creator not supplied; see original source. Mondaq summary of Moffatt v. Air Canada (2024 BCCRT 149), where the airline was held liable for its chatbot's misinformation. Beginner · unknown · unknown resource · en - ### [OpenAI Deployment Safety Hub](/security-and-red-teaming/safety-and-alignment-evals/openai-deployment-safety-hub-system-cards/index.md) Creator not supplied; see original source. OpenAI Deployment Safety Hub: system cards with safety evaluations and safeguards for deployed OpenAI models. Beginner–Expert · unknown · unknown resource · en - ### [OWASP Top 10 for LLM Applications](/security-and-red-teaming/safety-and-alignment-evals/owasp-top-10-for-llm-applications/index.md) Creator not supplied; see original source. OWASP Top 10 for LLM Applications 2026: community list of security risks in LLM-powered applications with mitigations. Beginner–Intermediate · unknown · unknown resource · en - ### [Final report of the Royal Commission into the Robodebt Scheme (Prime Minister of Australia)](/security-and-red-teaming/safety-and-alignment-evals/royal-commission-into-the-robodebt-scheme-final-report-pm-media-release/index.md) Creator not supplied; see original source. Australian Prime Minister's media release on the final report of the Royal Commission into the Robodebt automated debt scheme. Beginner–Expert · unknown · unknown resource · en - ### [Simon Willison on the AI hallucination cases database](/security-and-red-teaming/safety-and-alignment-evals/simon-willison-on-the-ai-hallucination-cases-database/index.md) Creator not supplied; see original source. Simon Willison's post on Damien Charlotin's database of legal decisions involving AI-hallucinated content. Beginner · unknown · unknown resource · en - ### [Replit makes vibe-y promise to prevent vibe coding disasters (The Register)](/security-and-red-teaming/safety-and-alignment-evals/the-register-replit-s-response/index.md) Creator not supplied; see original source. The Register follow-up on Replit's response, including separate development and production databases. Beginner · unknown · unknown resource · en - ### [Vibe coding service Replit deleted production database (The Register)](/security-and-red-teaming/safety-and-alignment-evals/the-register-replit-saastr-vibe-coding-incident/index.md) Creator not supplied; see original source. The Register report on Replit's agent deleting SaaStr's production database during a code freeze in July 2025. Beginner · unknown · unknown resource · en - ### [Zed docs: AI privacy and security](/security-and-red-teaming/safety-and-alignment-evals/zed-ai-privacy-and-security/index.md) Creator not supplied; see original source. Zed documentation on AI privacy and security: what data leaves the machine when using AI features. Beginner · unknown · unknown resource · en [Previous page](/security-and-red-teaming/beginner/index.md) [Plain-text Markdown copy](/security-and-red-teaming/beginner/page/2/index.md)