incidents & failure cases: 41 curated resources
incidents & failure cases
41 resources · page 2 of 2
Sal Khan: Khanmigo's First Chapter Changed How I Think About AI (Khan Academy)
by Khan Academy
Sal Khan's reflection on the first chapter of the Khanmigo AI tutor and what it changed for student learning.
A postmortem of three recent issues
by Anthropic
Anthropic postmortem explaining three infrastructure bugs that intermittently degraded Claude's responses and how they were found.
An update on recent Claude Code quality reports (Anthropic)
by Anthropic
Anthropic postmortem on Claude Code quality reports, tracing degradations to three harness and prompt changes.
Hidden Technical Debt in Machine Learning Systems
Google Research publication page for Hidden Technical Debt in Machine Learning Systems (NeurIPS 2015).
Investigating unintended model actions in our evaluations and internal use
by Anthropic
Anthropic post investigating unintended model actions observed in its evaluations and internal use.
Leakage and the Reproducibility Crisis in ML-based Science
by Sayash Kapoor and Arvind Narayanan (Princeton University)
arXiv paper (2022) "Leakage and the Reproducibility Crisis in ML-based Science", documenting data leakage as a cause of reproducibility failures in ML-based science.
Lost in the Middle
by Nelson F. Liu et al. (Stanford University)
arXiv paper (2023) "Lost in the Middle", showing LLM accuracy drops for information placed mid-context.
Shortcut Learning in Deep Neural Networks
by Robert Geirhos et al. (University of Tübingen)
arXiv paper (2020) "Shortcut Learning in Deep Neural Networks", analysing how networks learn shortcut solutions that fail under distribution shift.
Amnesty: Xenophobic Machines (Dutch childcare benefits)
Amnesty International report Xenophobic Machines on discriminatory algorithmic profiling in the Dutch childcare benefits scandal.