The Normalization of Deviance in AI Development
arXiv cs.AIen
arXiv:2609.05749v1 Announce Type: new Abstract: Work on the risks of artificial intelligence has focused predominantly on capability risk: the danger that systems become too powerful, too autonomous, or too misaligned with human values. Far less attention has been paid to the organizational level---to whether the institutions building these systems are themselves predisposed to drift toward failure. This paper argues that they are. Regardless of how capable AI systems become, the organizations building them face the same structural dynamics that preceded past major technological disasters. Drawing on case studies of the Space Shuttle Challenger, the Three Mile Island accident, and the Boeing
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Forskning
Related AI news
- Planning and Scheduling Business Processes under Control-Flow UncertaintyarXiv cs.AI · September 9, 2026
- Agents Trust Tools Too Much: Measuring Reliance on Unreliable ToolsarXiv cs.AI · September 9, 2026
- Distilling Vision-Language Models for On-Device Fire UnderstandingarXiv cs.AI · September 9, 2026
- When and What to Teach: Budget-Aware Online Adaptation for Web AgentsarXiv cs.AI · September 9, 2026
- RAPID: Reliability-Aware Pair Importance DistillationarXiv cs.AI · September 9, 2026
- Beyond "AI Helps Humans": Decision-Targeted Evaluation Design for Human-Agent Teams in the Agentic EraarXiv cs.AI · September 9, 2026