Incidents Failure Cases

41 resources · page 1 of 2

• 11x accused of claiming customers it doesn't have (TechCrunch)

  Creator not supplied; see original source.

  TechCrunch report on AI sales startup 11x claiming customers it did not have.

  Not applicable (entity) · unknown · unknown resource · en

• 9to5Mac: Figma explains why its AI kept copying Apple's Weather app

  Creator not supplied; see original source.

  9to5Mac report on Figma explaining why its Make Designs AI feature produced copies of Apple's Weather app.

  Not applicable (entity) · unknown · unknown resource · en

• Academ-AI

  Creator not supplied; see original source.

  Academ-AI paper documenting academic publications that contain undisclosed AI-generated text.

  Not applicable (entity) · unknown · unknown resource · en

• AI Hallucination Cases database (Damien Charlotin)

  Creator not supplied; see original source.

  Damien Charlotin's database of court decisions worldwide involving AI-hallucinated content in legal filings, searchable by country and tool.

  Not applicable (entity) · unknown · unknown resource · en

• AI Incident Database: Report 3918

  Creator not supplied; see original source.

  AI Incident Database report 3918, an article on AI hallucinations in legal practice, as an example incident record.

  Not applicable (entity) · unknown · unknown resource · en|es|fr|ja

• AIID taxonomies

  Creator not supplied; see original source.

  AI Incident Database taxonomies page listing the classification schemes, such as CSET and GMF, applied to incidents.

  Not applicable (entity) · unknown · unknown resource · en

• Amazon scraps biased AI recruiting tool (Euronews/Reuters)

  Creator not supplied; see original source.

  Euronews/Reuters report on Amazon scrapping an AI recruiting tool that showed bias against women.

  Not applicable (entity) · unknown · unknown resource · en

• Arup US$25M deepfake video-call fraud (Construction Briefing)

  Creator not supplied; see original source.

  Construction Briefing report on an Arup employee transferring US$25 million after a deepfake video call.

  Not applicable (entity) · unknown · unknown resource · en

• AVID

  Creator not supplied; see original source.

  AVID: open database of vulnerabilities and failure modes in general-purpose AI systems, structured like CVE entries.

  Not applicable (entity) · unknown · unknown resource · en

• DMV Statement on Cruise LLC Suspension (California DMV)

  Creator not supplied; see original source.

  California DMV statement (October 2023) suspending Cruise's driverless deployment and testing permits.

  Not applicable (entity) · unknown · unknown resource · en

• Chicago Sun-Times AI reading list of nonexistent books (404 Media)

  Creator not supplied; see original source.

  404 Media report on the Chicago Sun-Times printing an AI-generated summer reading list with nonexistent books.

  Not applicable (entity) · unknown · unknown resource · en

• CNET found errors in more than half its AI stories (Talking Biz News)

  Creator not supplied; see original source.

  Talking Biz News report on CNET correcting 41 of 77 stories written with an AI tool.

  Not applicable (entity) · unknown · unknown resource · en

• Cursor/Anysphere support bot invents a policy (CX Network)

  Creator not supplied; see original source.

  CX Network report on Cursor's support chatbot inventing a false policy and the resulting backlash.

  Not applicable (entity) · unknown · unknown resource · en

• Deloitte partial refund to Australian government over AI errors (CTV)

  Creator not supplied; see original source.

  CTV report on Deloitte partially refunding the Australian government for a report with AI-generated errors.

  Not applicable (entity) · unknown · unknown resource · en

• Zillow to shutter home buying business and lay off 2,000 employees (GeekWire)

  Creator not supplied; see original source.

  GeekWire report on Zillow closing its algorithm-driven home-buying business and laying off 2,000 staff.

  Not applicable (entity) · unknown · unknown resource · en

• Law Gazette: judge alerts regulators over fake case authorities

  Creator not supplied; see original source.

  Law Gazette report on a High Court judge referring lawyers to regulators over fake AI-generated case citations.

  Not applicable (entity) · unknown · unknown resource · en

• Global courts face rising tide of AI-generated fake cases and quotes (Malay Mail)

  Creator not supplied; see original source.

  Malay Mail report on courts worldwide sanctioning AI-generated fake cases and quotes in legal filings.

  Not applicable (entity) · unknown · unknown resource · en

• MAST

  Creator not supplied; see original source.

  MAST GitHub repo: taxonomy and dataset of failure modes in multi-agent LLM systems.

  Not applicable (entity) · unknown · unknown resource · en

• NTSB investigation HWY18MH010 (Uber ATG crash)

  Creator not supplied; see original source.

  NTSB investigation HWY18MH010: the 2018 Uber ATG automated test vehicle fatal crash in Tempe.

  Not applicable (entity) · unknown · unknown resource · en

• STAT: IBM Watson recommended "unsafe and incorrect" cancer treatments

  Creator not supplied; see original source.

  STAT report on internal IBM documents showing Watson for Oncology gave unsafe and incorrect treatment advice.

  Not applicable (entity) · unknown · unknown resource · en

• Stephenson Harwood: "Law and error"

  Creator not supplied; see original source.

  Stephenson Harwood article on court scrutiny of AI tools after fictitious citations in legal filings.

  Not applicable (entity) · unknown · unknown resource · en

• The Register: Figma AI accused of plagiarising Apple

  Creator not supplied; see original source.

  The Register report on Figma pulling its Make Designs AI feature after it copied Apple's Weather app.

  Not applicable (entity) · unknown · unknown resource · en

• TILOS MacroPlacement

  Creator not supplied; see original source.

  TILOS MacroPlacement GitHub repo: benchmarks, evaluators and an open reproduction of Google's Circuit Training for chip macro placement.

  Not applicable (entity) · unknown · unknown resource · en

• BC CRT decision document (primary)

  Creator not supplied; see original source.

  British Columbia Civil Resolution Tribunal decision document; the tribunal decided the Moffatt v. Air Canada chatbot case.

  Beginner · unknown · unknown resource · en

• AI Agent Wipes Production Database, Then Lies About It (eWeek)

  Creator not supplied; see original source.

  eWeek report on a Replit AI agent deleting a company's production database during a code freeze in a SaaStr experiment.

  Beginner · unknown · unknown resource · en

• Airline Ordered To Compensate A B.C. Man Because Its Chatbot Provided Inaccurate Information (Mondaq)

  Creator not supplied; see original source.

  Mondaq summary of Moffatt v. Air Canada (2024 BCCRT 149), where the airline was held liable for its chatbot's misinformation.

  Beginner · unknown · unknown resource · en

• Final report of the Royal Commission into the Robodebt Scheme (Prime Minister of Australia)

  Creator not supplied; see original source.

  Australian Prime Minister's media release on the final report of the Royal Commission into the Robodebt automated debt scheme.

  Beginner–Expert · unknown · unknown resource · en

• Simon Willison on the AI hallucination cases database

  Creator not supplied; see original source.

  Simon Willison's post on Damien Charlotin's database of legal decisions involving AI-hallucinated content.

  Beginner · unknown · unknown resource · en

• Replit makes vibe-y promise to prevent vibe coding disasters (The Register)

  Creator not supplied; see original source.

  The Register follow-up on Replit's response, including separate development and production databases.

  Beginner · unknown · unknown resource · en

• Vibe coding service Replit deleted production database (The Register)

  Creator not supplied; see original source.

  The Register report on Replit's agent deleting SaaStr's production database during a code freeze in July 2025.

  Beginner · unknown · unknown resource · en

• Statement on CVE-2025-48757 (Matt Palmer)

  Creator not supplied; see original source.

  Matt Palmer's statement on CVE-2025-48757: missing row-level security in Lovable-generated apps exposed user data.

  Intermediate · unknown · unknown resource · en

• Retraction Watch: papers with evidence of ChatGPT writing

  Creator not supplied; see original source.

  Retraction Watch running list of published papers and peer reviews containing evidence of ChatGPT-written text.

  Intermediate · unknown · unknown resource · en

Plain-text Markdown copy