--- id: "/safety-security-interpretability/incidents-failure-cases/" title: "incidents & failure cases: 41 curated resources" url: "https://skillissue.dev/safety-security-interpretability/incidents-failure-cases/" --- # incidents & failure cases: 41 curated resources incidents & failure cases [Beginner](/safety-security-interpretability/beginner/index.md) [Intermediate](/safety-security-interpretability/intermediate/index.md) [Advanced](/safety-security-interpretability/advanced/index.md) [Expert](/safety-security-interpretability/expert/index.md) 41 resources · page 1 of 2 - ### [11x accused of claiming customers it doesn't have (TechCrunch)](/security-and-red-teaming/safety-and-alignment-evals/11x-accused-of-claiming-customers-it-doesn-t-have-techcrunch/index.md) by [TechCrunch](https://techcrunch.com/) TechCrunch report on AI sales startup 11x claiming customers it did not have. entity news US en - ### [9to5Mac: Figma explains why its AI kept copying Apple's Weather app](/security-and-red-teaming/safety-and-alignment-evals/9to5mac-figma-explains-why-its-ai-kept-copying-apple-s-weather-app/index.md) by [9to5Mac](https://9to5mac.com/) 9to5Mac report on Figma explaining why its Make Designs AI feature produced copies of Apple's Weather app. entity news US en - ### [Academ-AI](/security-and-red-teaming/safety-and-alignment-evals/academ-ai-undisclosed-genai-use-in-academic-publishing-arxiv-2411-15218/index.md) by [Alex Glynn (University of Louisville)](https://louisville.edu) Academ-AI paper documenting academic publications that contain undisclosed AI-generated text. entity dataset Global en - ### [AI Hallucination Cases database (Damien Charlotin)](/security-and-red-teaming/safety-and-alignment-evals/ai-hallucination-cases-database-damien-charlotin/index.md) by [Damien Charlotin](https://www.damiencharlotin.com/) Damien Charlotin's database of court decisions worldwide involving AI-hallucinated content in legal filings, searchable by country and tool. entity dataset Global en - ### [AI Incident Database: Report 3918](/security-and-red-teaming/safety-and-alignment-evals/ai-incident-database-example-legal-hallucination-report/index.md) by [Responsible AI Collaborative](https://incidentdatabase.ai/) AI Incident Database report 3918, an article on AI hallucinations in legal practice, as an example incident record. entity dataset Global en|es|fr|ja - ### [AIID taxonomies](/security-and-red-teaming/safety-and-alignment-evals/aiid-taxonomies/index.md) by [Responsible AI Collaborative](https://incidentdatabase.ai/) AI Incident Database taxonomies page listing the classification schemes, such as CSET and GMF, applied to incidents. entity dataset US en - ### [Amazon scraps biased AI recruiting tool (Euronews/Reuters)](/security-and-red-teaming/safety-and-alignment-evals/amazon-scraps-biased-ai-recruiting-tool-euronews-reuters/index.md) by [Euronews](https://www.euronews.com/) Euronews/Reuters report on Amazon scrapping an AI recruiting tool that showed bias against women. entity news US en - ### [Arup US$25M deepfake video-call fraud (Construction Briefing)](/security-and-red-teaming/safety-and-alignment-evals/arup-us-25m-deepfake-video-call-fraud-construction-briefing/index.md) by [Construction Briefing](https://constructionbriefing.com/) Construction Briefing report on an Arup employee transferring US$25 million after a deepfake video call. entity news Hong Kong/UK en - ### [AVID](/security-and-red-teaming/safety-and-alignment-evals/avid/index.md) by [AI Vulnerability Database (AVID)](https://avidml.org/) AVID: open database of vulnerabilities and failure modes in general-purpose AI systems, structured like CVE entries. entity dataset US en - ### [DMV Statement on Cruise LLC Suspension (California DMV)](/security-and-red-teaming/safety-and-alignment-evals/ca-dmv-statement-on-cruise-suspension-oct-2023/index.md) by [California DMV](https://dmv.ca.gov/) California DMV statement (October 2023) suspending Cruise's driverless deployment and testing permits. entity standard-policy US (CA) en - ### [Chicago Sun-Times AI reading list of nonexistent books (404 Media)](/security-and-red-teaming/safety-and-alignment-evals/chicago-sun-times-ai-reading-list-of-nonexistent-books-404-media/index.md) by [404 Media](https://404media.co/) 404 Media report on the Chicago Sun-Times printing an AI-generated summer reading list with nonexistent books. entity news US en - ### [CNET found errors in more than half its AI stories (Talking Biz News)](/security-and-red-teaming/safety-and-alignment-evals/cnet-found-errors-in-more-than-half-its-ai-stories-talking-biz-news/index.md) by [Talking Biz News](https://talkingbiznews.com/) Talking Biz News report on CNET correcting 41 of 77 stories written with an AI tool. entity news US en - ### [Cursor/Anysphere support bot invents a policy (CX Network)](/security-and-red-teaming/safety-and-alignment-evals/cursor-anysphere-support-bot-invents-a-policy-cx-network/index.md) by [CX Network](https://cxnetwork.com/) CX Network report on Cursor's support chatbot inventing a false policy and the resulting backlash. entity news US en - ### [Deloitte partial refund to Australian government over AI errors (CTV)](/security-and-red-teaming/safety-and-alignment-evals/deloitte-partial-refund-to-australian-government-over-ai-errors-ctv/index.md) by [CTVNews](https://ctvnews.ca/) CTV report on Deloitte partially refunding the Australian government for a report with AI-generated errors. entity news Australia en - ### [Zillow to shutter home buying business and lay off 2,000 employees (GeekWire)](/security-and-red-teaming/safety-and-alignment-evals/geekwire-zillow-shuts-home-buying-business-lays-off-2-000-nov-2021/index.md) by [GeekWire](https://geekwire.com/) GeekWire report on Zillow closing its algorithm-driven home-buying business and laying off 2,000 staff. entity news US en - ### [Law Gazette: judge alerts regulators over fake case authorities](/security-and-red-teaming/safety-and-alignment-evals/law-gazette-judge-alerts-regulators-over-fake-case-authorities/index.md) by [Law Gazette](https://lawgazette.co.uk/) Law Gazette report on a High Court judge referring lawyers to regulators over fake AI-generated case citations. entity news UK en - ### [Global courts face rising tide of AI-generated fake cases and quotes (Malay Mail)](/security-and-red-teaming/safety-and-alignment-evals/malay-mail-global-courts-face-rising-tide-of-ai-fake-cases-jun-2026/index.md) by [Malay Mail](https://malaymail.com/) Malay Mail report on courts worldwide sanctioning AI-generated fake cases and quotes in legal filings. entity news Malaysia/Global en - ### [MAST](/security-and-red-teaming/safety-and-alignment-evals/mast-repo/index.md) by [multi-agent-systems-failure-taxonomy](https://github.com/multi-agent-systems-failure-taxonomy) MAST GitHub repo: taxonomy and dataset of failure modes in multi-agent LLM systems. entity repo US en - ### [NTSB investigation HWY18MH010 (Uber ATG crash)](/security-and-red-teaming/safety-and-alignment-evals/ntsb-hwy18mh010-uber-atg-fatal-crash-tempe/index.md) by [US National Transportation Safety Board (NTSB)](https://www.ntsb.gov/) NTSB investigation HWY18MH010: the 2018 Uber ATG automated test vehicle fatal crash in Tempe. entity standard-policy US en - ### [STAT: IBM Watson recommended "unsafe and incorrect" cancer treatments](/security-and-red-teaming/safety-and-alignment-evals/stat-ibm-watson-recommended-unsafe-and-incorrect-cancer-treatments/index.md) by [STAT](https://statnews.com/) STAT report on internal IBM documents showing Watson for Oncology gave unsafe and incorrect treatment advice. entity news US en - ### [Stephenson Harwood: "Law and error"](/security-and-red-teaming/safety-and-alignment-evals/stephenson-harwood-law-and-error/index.md) by [Stephenson Harwood](https://stephensonharwood.com/) Stephenson Harwood article on court scrutiny of AI tools after fictitious citations in legal filings. entity standard-policy UK en - ### [The Register: Figma AI accused of plagiarising Apple](/security-and-red-teaming/safety-and-alignment-evals/the-register-figma-ai-accused-of-plagiarising-apple/index.md) by [The Register](https://www.theregister.com/) The Register report on Figma pulling its Make Designs AI feature after it copied Apple's Weather app. entity news UK en - ### [TILOS MacroPlacement](/security-and-red-teaming/safety-and-alignment-evals/tilos-macroplacement/index.md) by [TILOS-AI-Institute](https://github.com/TILOS-AI-Institute) TILOS MacroPlacement GitHub repo: benchmarks, evaluators and an open reproduction of Google's Circuit Training for chip macro placement. entity company US en - ### [BC CRT decision document (primary)](/security-and-red-teaming/safety-and-alignment-evals/bc-crt-decision-document-primary/index.md) by [Civil Resolution Tribunal (British Columbia)](https://civilresolutionbc.ca/) British Columbia Civil Resolution Tribunal decision document; the tribunal decided the Moffatt v. Air Canada chatbot case. Beginner learning_resource guide Canada en - ### [AI Agent Wipes Production Database, Then Lies About It (eWeek)](/security-and-red-teaming/safety-and-alignment-evals/eweek-ai-agent-wipes-production-database-then-lies-about-it-replit-saastr-2025-0/index.md) by [eWeek](https://eweek.com/) eWeek report on a Replit AI agent deleting a company's production database during a code freeze in a SaaStr experiment. Beginner learning_resource guide US en - ### [Airline Ordered To Compensate A B.C. Man Because Its Chatbot Provided Inaccurate Information (Mondaq)](/security-and-red-teaming/safety-and-alignment-evals/mondaq-moffatt-v-air-canada-2024-bccrt-149/index.md) by [Mondaq](https://mondaq.com/) Mondaq summary of Moffatt v. Air Canada (2024 BCCRT 149), where the airline was held liable for its chatbot's misinformation. Beginner learning_resource guide Canada en - ### [Final report of the Royal Commission into the Robodebt Scheme (Prime Minister of Australia)](/security-and-red-teaming/safety-and-alignment-evals/royal-commission-into-the-robodebt-scheme-final-report-pm-media-release/index.md) by [Prime Minister of Australia](https://www.pm.gov.au/) Australian Prime Minister's media release on the final report of the Royal Commission into the Robodebt automated debt scheme. Beginner–Expert learning_resource guide Australia en - ### [Simon Willison on the AI hallucination cases database](/security-and-red-teaming/safety-and-alignment-evals/simon-willison-on-the-ai-hallucination-cases-database/index.md) by [Simon Willison](https://simonwillison.net/) Simon Willison's post on Damien Charlotin's database of legal decisions involving AI-hallucinated content. Beginner learning_resource blog UK/US en - ### [Replit makes vibe-y promise to prevent vibe coding disasters (The Register)](/security-and-red-teaming/safety-and-alignment-evals/the-register-replit-s-response/index.md) by [The Register](https://www.theregister.com/) The Register follow-up on Replit's response, including separate development and production databases. Beginner learning_resource guide UK en - ### [Vibe coding service Replit deleted production database (The Register)](/security-and-red-teaming/safety-and-alignment-evals/the-register-replit-saastr-vibe-coding-incident/index.md) by [The Register](https://www.theregister.com/) The Register report on Replit's agent deleting SaaStr's production database during a code freeze in July 2025. Beginner learning_resource guide UK en - ### [Statement on CVE-2025-48757 (Matt Palmer)](/security-and-red-teaming/safety-and-alignment-evals/matt-palmer-statement-on-cve-2025-48757-2025-05-29/index.md) by [Matt Palmer](https://mattpalmer.io/) Matt Palmer's statement on CVE-2025-48757: missing row-level security in Lovable-generated apps exposed user data. Intermediate learning_resource guide US en - ### [Retraction Watch: papers with evidence of ChatGPT writing](/security-and-red-teaming/safety-and-alignment-evals/retraction-watch-papers-with-evidence-of-chatgpt-writing/index.md) by [Retraction Watch](https://retractionwatch.com/) Retraction Watch running list of published papers and peer reviews containing evidence of ChatGPT-written text. Intermediate learning_resource guide Global en [Next page](/safety-security-interpretability/incidents-failure-cases/page/2/index.md) [Plain-text Markdown copy](/safety-security-interpretability/incidents-failure-cases/index.md)