--- id: "/tags/incidents-failure-cases/" title: "Incidents Failure Cases" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/tags/incidents-failure-cases/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Incidents Failure Cases [Beginner](/levels/beginner/index.md) [Intermediate](/levels/intermediate/index.md) [Advanced](/levels/advanced/index.md) [Expert](/levels/expert/index.md) 41 resources · page 1 of 2 - ### [11x accused of claiming customers it doesn't have (TechCrunch)](/security-and-red-teaming/safety-and-alignment-evals/11x-accused-of-claiming-customers-it-doesn-t-have-techcrunch/index.md) Creator not supplied; see original source. TechCrunch report on AI sales startup 11x claiming customers it did not have. Not applicable (entity) · unknown · unknown resource · en - ### [9to5Mac: Figma explains why its AI kept copying Apple's Weather app](/security-and-red-teaming/safety-and-alignment-evals/9to5mac-figma-explains-why-its-ai-kept-copying-apple-s-weather-app/index.md) Creator not supplied; see original source. 9to5Mac report on Figma explaining why its Make Designs AI feature produced copies of Apple's Weather app. Not applicable (entity) · unknown · unknown resource · en - ### [Academ-AI](/security-and-red-teaming/safety-and-alignment-evals/academ-ai-undisclosed-genai-use-in-academic-publishing-arxiv-2411-15218/index.md) Creator not supplied; see original source. Academ-AI paper documenting academic publications that contain undisclosed AI-generated text. Not applicable (entity) · unknown · unknown resource · en - ### [AI Hallucination Cases database (Damien Charlotin)](/security-and-red-teaming/safety-and-alignment-evals/ai-hallucination-cases-database-damien-charlotin/index.md) Creator not supplied; see original source. Damien Charlotin's database of court decisions worldwide involving AI-hallucinated content in legal filings, searchable by country and tool. Not applicable (entity) · unknown · unknown resource · en - ### [AI Incident Database: Report 3918](/security-and-red-teaming/safety-and-alignment-evals/ai-incident-database-example-legal-hallucination-report/index.md) Creator not supplied; see original source. AI Incident Database report 3918, an article on AI hallucinations in legal practice, as an example incident record. Not applicable (entity) · unknown · unknown resource · en|es|fr|ja - ### [AIID taxonomies](/security-and-red-teaming/safety-and-alignment-evals/aiid-taxonomies/index.md) Creator not supplied; see original source. AI Incident Database taxonomies page listing the classification schemes, such as CSET and GMF, applied to incidents. Not applicable (entity) · unknown · unknown resource · en - ### [Amazon scraps biased AI recruiting tool (Euronews/Reuters)](/security-and-red-teaming/safety-and-alignment-evals/amazon-scraps-biased-ai-recruiting-tool-euronews-reuters/index.md) Creator not supplied; see original source. Euronews/Reuters report on Amazon scrapping an AI recruiting tool that showed bias against women. Not applicable (entity) · unknown · unknown resource · en - ### [Arup US$25M deepfake video-call fraud (Construction Briefing)](/security-and-red-teaming/safety-and-alignment-evals/arup-us-25m-deepfake-video-call-fraud-construction-briefing/index.md) Creator not supplied; see original source. Construction Briefing report on an Arup employee transferring US$25 million after a deepfake video call. Not applicable (entity) · unknown · unknown resource · en - ### [AVID](/security-and-red-teaming/safety-and-alignment-evals/avid/index.md) Creator not supplied; see original source. AVID: open database of vulnerabilities and failure modes in general-purpose AI systems, structured like CVE entries. Not applicable (entity) · unknown · unknown resource · en - ### [DMV Statement on Cruise LLC Suspension (California DMV)](/security-and-red-teaming/safety-and-alignment-evals/ca-dmv-statement-on-cruise-suspension-oct-2023/index.md) Creator not supplied; see original source. California DMV statement (October 2023) suspending Cruise's driverless deployment and testing permits. Not applicable (entity) · unknown · unknown resource · en - ### [Chicago Sun-Times AI reading list of nonexistent books (404 Media)](/security-and-red-teaming/safety-and-alignment-evals/chicago-sun-times-ai-reading-list-of-nonexistent-books-404-media/index.md) Creator not supplied; see original source. 404 Media report on the Chicago Sun-Times printing an AI-generated summer reading list with nonexistent books. Not applicable (entity) · unknown · unknown resource · en - ### [CNET found errors in more than half its AI stories (Talking Biz News)](/security-and-red-teaming/safety-and-alignment-evals/cnet-found-errors-in-more-than-half-its-ai-stories-talking-biz-news/index.md) Creator not supplied; see original source. Talking Biz News report on CNET correcting 41 of 77 stories written with an AI tool. Not applicable (entity) · unknown · unknown resource · en - ### [Cursor/Anysphere support bot invents a policy (CX Network)](/security-and-red-teaming/safety-and-alignment-evals/cursor-anysphere-support-bot-invents-a-policy-cx-network/index.md) Creator not supplied; see original source. CX Network report on Cursor's support chatbot inventing a false policy and the resulting backlash. Not applicable (entity) · unknown · unknown resource · en - ### [Deloitte partial refund to Australian government over AI errors (CTV)](/security-and-red-teaming/safety-and-alignment-evals/deloitte-partial-refund-to-australian-government-over-ai-errors-ctv/index.md) Creator not supplied; see original source. CTV report on Deloitte partially refunding the Australian government for a report with AI-generated errors. Not applicable (entity) · unknown · unknown resource · en - ### [Zillow to shutter home buying business and lay off 2,000 employees (GeekWire)](/security-and-red-teaming/safety-and-alignment-evals/geekwire-zillow-shuts-home-buying-business-lays-off-2-000-nov-2021/index.md) Creator not supplied; see original source. GeekWire report on Zillow closing its algorithm-driven home-buying business and laying off 2,000 staff. Not applicable (entity) · unknown · unknown resource · en - ### [Law Gazette: judge alerts regulators over fake case authorities](/security-and-red-teaming/safety-and-alignment-evals/law-gazette-judge-alerts-regulators-over-fake-case-authorities/index.md) Creator not supplied; see original source. Law Gazette report on a High Court judge referring lawyers to regulators over fake AI-generated case citations. Not applicable (entity) · unknown · unknown resource · en - ### [Global courts face rising tide of AI-generated fake cases and quotes (Malay Mail)](/security-and-red-teaming/safety-and-alignment-evals/malay-mail-global-courts-face-rising-tide-of-ai-fake-cases-jun-2026/index.md) Creator not supplied; see original source. Malay Mail report on courts worldwide sanctioning AI-generated fake cases and quotes in legal filings. Not applicable (entity) · unknown · unknown resource · en - ### [MAST](/security-and-red-teaming/safety-and-alignment-evals/mast-repo/index.md) Creator not supplied; see original source. MAST GitHub repo: taxonomy and dataset of failure modes in multi-agent LLM systems. Not applicable (entity) · unknown · unknown resource · en - ### [NTSB investigation HWY18MH010 (Uber ATG crash)](/security-and-red-teaming/safety-and-alignment-evals/ntsb-hwy18mh010-uber-atg-fatal-crash-tempe/index.md) Creator not supplied; see original source. NTSB investigation HWY18MH010: the 2018 Uber ATG automated test vehicle fatal crash in Tempe. Not applicable (entity) · unknown · unknown resource · en - ### [STAT: IBM Watson recommended "unsafe and incorrect" cancer treatments](/security-and-red-teaming/safety-and-alignment-evals/stat-ibm-watson-recommended-unsafe-and-incorrect-cancer-treatments/index.md) Creator not supplied; see original source. STAT report on internal IBM documents showing Watson for Oncology gave unsafe and incorrect treatment advice. Not applicable (entity) · unknown · unknown resource · en - ### [Stephenson Harwood: "Law and error"](/security-and-red-teaming/safety-and-alignment-evals/stephenson-harwood-law-and-error/index.md) Creator not supplied; see original source. Stephenson Harwood article on court scrutiny of AI tools after fictitious citations in legal filings. Not applicable (entity) · unknown · unknown resource · en - ### [The Register: Figma AI accused of plagiarising Apple](/security-and-red-teaming/safety-and-alignment-evals/the-register-figma-ai-accused-of-plagiarising-apple/index.md) Creator not supplied; see original source. The Register report on Figma pulling its Make Designs AI feature after it copied Apple's Weather app. Not applicable (entity) · unknown · unknown resource · en - ### [TILOS MacroPlacement](/security-and-red-teaming/safety-and-alignment-evals/tilos-macroplacement/index.md) Creator not supplied; see original source. TILOS MacroPlacement GitHub repo: benchmarks, evaluators and an open reproduction of Google's Circuit Training for chip macro placement. Not applicable (entity) · unknown · unknown resource · en - ### [BC CRT decision document (primary)](/security-and-red-teaming/safety-and-alignment-evals/bc-crt-decision-document-primary/index.md) Creator not supplied; see original source. British Columbia Civil Resolution Tribunal decision document; the tribunal decided the Moffatt v. Air Canada chatbot case. Beginner · unknown · unknown resource · en - ### [AI Agent Wipes Production Database, Then Lies About It (eWeek)](/security-and-red-teaming/safety-and-alignment-evals/eweek-ai-agent-wipes-production-database-then-lies-about-it-replit-saastr-2025-0/index.md) Creator not supplied; see original source. eWeek report on a Replit AI agent deleting a company's production database during a code freeze in a SaaStr experiment. Beginner · unknown · unknown resource · en - ### [Airline Ordered To Compensate A B.C. Man Because Its Chatbot Provided Inaccurate Information (Mondaq)](/security-and-red-teaming/safety-and-alignment-evals/mondaq-moffatt-v-air-canada-2024-bccrt-149/index.md) Creator not supplied; see original source. Mondaq summary of Moffatt v. Air Canada (2024 BCCRT 149), where the airline was held liable for its chatbot's misinformation. Beginner · unknown · unknown resource · en - ### [Final report of the Royal Commission into the Robodebt Scheme (Prime Minister of Australia)](/security-and-red-teaming/safety-and-alignment-evals/royal-commission-into-the-robodebt-scheme-final-report-pm-media-release/index.md) Creator not supplied; see original source. Australian Prime Minister's media release on the final report of the Royal Commission into the Robodebt automated debt scheme. Beginner–Expert · unknown · unknown resource · en - ### [Simon Willison on the AI hallucination cases database](/security-and-red-teaming/safety-and-alignment-evals/simon-willison-on-the-ai-hallucination-cases-database/index.md) Creator not supplied; see original source. Simon Willison's post on Damien Charlotin's database of legal decisions involving AI-hallucinated content. Beginner · unknown · unknown resource · en - ### [Replit makes vibe-y promise to prevent vibe coding disasters (The Register)](/security-and-red-teaming/safety-and-alignment-evals/the-register-replit-s-response/index.md) Creator not supplied; see original source. The Register follow-up on Replit's response, including separate development and production databases. Beginner · unknown · unknown resource · en - ### [Vibe coding service Replit deleted production database (The Register)](/security-and-red-teaming/safety-and-alignment-evals/the-register-replit-saastr-vibe-coding-incident/index.md) Creator not supplied; see original source. The Register report on Replit's agent deleting SaaStr's production database during a code freeze in July 2025. Beginner · unknown · unknown resource · en - ### [Statement on CVE-2025-48757 (Matt Palmer)](/security-and-red-teaming/safety-and-alignment-evals/matt-palmer-statement-on-cve-2025-48757-2025-05-29/index.md) Creator not supplied; see original source. Matt Palmer's statement on CVE-2025-48757: missing row-level security in Lovable-generated apps exposed user data. Intermediate · unknown · unknown resource · en - ### [Retraction Watch: papers with evidence of ChatGPT writing](/security-and-red-teaming/safety-and-alignment-evals/retraction-watch-papers-with-evidence-of-chatgpt-writing/index.md) Creator not supplied; see original source. Retraction Watch running list of published papers and peer reviews containing evidence of ChatGPT-written text. Intermediate · unknown · unknown resource · en [Next page](/tags/incidents-failure-cases/page/2/index.md) [Plain-text Markdown copy](/tags/incidents-failure-cases/index.md)