Incidents Failure Cases
41 resources · page 2 of 2
Sal Khan: Khanmigo's First Chapter Changed How I Think About AI (Khan Academy)
Creator not supplied; see original source.
Sal Khan's reflection on the first chapter of the Khanmigo AI tutor and what it changed for student learning.
A postmortem of three recent issues
Creator not supplied; see original source.
Anthropic postmortem explaining three infrastructure bugs that intermittently degraded Claude's responses and how they were found.
An update on recent Claude Code quality reports (Anthropic)
Creator not supplied; see original source.
Anthropic postmortem on Claude Code quality reports, tracing degradations to three harness and prompt changes.
Hidden Technical Debt in Machine Learning Systems
Creator not supplied; see original source.
Google Research publication page for Hidden Technical Debt in Machine Learning Systems (NeurIPS 2015).
Investigating unintended model actions in our evaluations and internal use
Creator not supplied; see original source.
Anthropic post investigating unintended model actions observed in its evaluations and internal use.
Leakage and the Reproducibility Crisis in ML-based Science
Creator not supplied; see original source.
arXiv paper (2022) "Leakage and the Reproducibility Crisis in ML-based Science", documenting data leakage as a cause of reproducibility failures in ML-based science.
Lost in the Middle
Creator not supplied; see original source.
arXiv paper (2023) "Lost in the Middle", showing LLM accuracy drops for information placed mid-context.
Shortcut Learning in Deep Neural Networks
Creator not supplied; see original source.
arXiv paper (2020) "Shortcut Learning in Deep Neural Networks", analysing how networks learn shortcut solutions that fail under distribution shift.
Amnesty: Xenophobic Machines (Dutch childcare benefits)
Creator not supplied; see original source.
Amnesty International report Xenophobic Machines on discriminatory algorithmic profiling in the Dutch childcare benefits scandal.