incidents & failure cases: 41 curated resources
incidents & failure cases
41 resources · page 1 of 2
11x accused of claiming customers it doesn't have (TechCrunch)
by TechCrunch
TechCrunch report on AI sales startup 11x claiming customers it did not have.
9to5Mac: Figma explains why its AI kept copying Apple's Weather app
by 9to5Mac
9to5Mac report on Figma explaining why its Make Designs AI feature produced copies of Apple's Weather app.
Academ-AI
by Alex Glynn (University of Louisville)
Academ-AI paper documenting academic publications that contain undisclosed AI-generated text.
AI Hallucination Cases database (Damien Charlotin)
Damien Charlotin's database of court decisions worldwide involving AI-hallucinated content in legal filings, searchable by country and tool.
AI Incident Database: Report 3918
by Responsible AI Collaborative
AI Incident Database report 3918, an article on AI hallucinations in legal practice, as an example incident record.
AIID taxonomies
by Responsible AI Collaborative
AI Incident Database taxonomies page listing the classification schemes, such as CSET and GMF, applied to incidents.
Amazon scraps biased AI recruiting tool (Euronews/Reuters)
by Euronews
Euronews/Reuters report on Amazon scrapping an AI recruiting tool that showed bias against women.
Arup US$25M deepfake video-call fraud (Construction Briefing)
Construction Briefing report on an Arup employee transferring US$25 million after a deepfake video call.
AVID
by AI Vulnerability Database (AVID)
AVID: open database of vulnerabilities and failure modes in general-purpose AI systems, structured like CVE entries.
DMV Statement on Cruise LLC Suspension (California DMV)
California DMV statement (October 2023) suspending Cruise's driverless deployment and testing permits.
Chicago Sun-Times AI reading list of nonexistent books (404 Media)
by 404 Media
404 Media report on the Chicago Sun-Times printing an AI-generated summer reading list with nonexistent books.
CNET found errors in more than half its AI stories (Talking Biz News)
Talking Biz News report on CNET correcting 41 of 77 stories written with an AI tool.
Cursor/Anysphere support bot invents a policy (CX Network)
by CX Network
CX Network report on Cursor's support chatbot inventing a false policy and the resulting backlash.
Deloitte partial refund to Australian government over AI errors (CTV)
by CTVNews
CTV report on Deloitte partially refunding the Australian government for a report with AI-generated errors.
Zillow to shutter home buying business and lay off 2,000 employees (GeekWire)
by GeekWire
GeekWire report on Zillow closing its algorithm-driven home-buying business and laying off 2,000 staff.
Law Gazette: judge alerts regulators over fake case authorities
by Law Gazette
Law Gazette report on a High Court judge referring lawyers to regulators over fake AI-generated case citations.
Global courts face rising tide of AI-generated fake cases and quotes (Malay Mail)
by Malay Mail
Malay Mail report on courts worldwide sanctioning AI-generated fake cases and quotes in legal filings.
MAST
by multi-agent-systems-failure-taxonomy
MAST GitHub repo: taxonomy and dataset of failure modes in multi-agent LLM systems.
NTSB investigation HWY18MH010 (Uber ATG crash)
by US National Transportation Safety Board (NTSB)
NTSB investigation HWY18MH010: the 2018 Uber ATG automated test vehicle fatal crash in Tempe.
STAT: IBM Watson recommended "unsafe and incorrect" cancer treatments
by STAT
STAT report on internal IBM documents showing Watson for Oncology gave unsafe and incorrect treatment advice.
Stephenson Harwood: "Law and error"
Stephenson Harwood article on court scrutiny of AI tools after fictitious citations in legal filings.
The Register: Figma AI accused of plagiarising Apple
by The Register
The Register report on Figma pulling its Make Designs AI feature after it copied Apple's Weather app.
TILOS MacroPlacement
TILOS MacroPlacement GitHub repo: benchmarks, evaluators and an open reproduction of Google's Circuit Training for chip macro placement.
BC CRT decision document (primary)
by Civil Resolution Tribunal (British Columbia)
British Columbia Civil Resolution Tribunal decision document; the tribunal decided the Moffatt v. Air Canada chatbot case.
AI Agent Wipes Production Database, Then Lies About It (eWeek)
by eWeek
eWeek report on a Replit AI agent deleting a company's production database during a code freeze in a SaaStr experiment.
Airline Ordered To Compensate A B.C. Man Because Its Chatbot Provided Inaccurate Information (Mondaq)
by Mondaq
Mondaq summary of Moffatt v. Air Canada (2024 BCCRT 149), where the airline was held liable for its chatbot's misinformation.
Final report of the Royal Commission into the Robodebt Scheme (Prime Minister of Australia)
by Prime Minister of Australia
Australian Prime Minister's media release on the final report of the Royal Commission into the Robodebt automated debt scheme.
Simon Willison on the AI hallucination cases database
Simon Willison's post on Damien Charlotin's database of legal decisions involving AI-hallucinated content.
Replit makes vibe-y promise to prevent vibe coding disasters (The Register)
by The Register
The Register follow-up on Replit's response, including separate development and production databases.
Vibe coding service Replit deleted production database (The Register)
by The Register
The Register report on Replit's agent deleting SaaStr's production database during a code freeze in July 2025.
Statement on CVE-2025-48757 (Matt Palmer)
by Matt Palmer
Matt Palmer's statement on CVE-2025-48757: missing row-level security in Lovable-generated apps exposed user data.
Retraction Watch: papers with evidence of ChatGPT writing
Retraction Watch running list of published papers and peer reviews containing evidence of ChatGPT-written text.