On the Computational, Informational, and Physical Foundations for AI Safety
Current approaches to AI safety predominantly focus on specifying correct behavior through software, data, and rules. This work argues that this approach faces theoretically fundamental, and not merely practical, limitations. I present a multi-layered analysis of this paradigm, demonstrating its inherent barriers from the perspectives of computational complexity, information theory, and physical engineering. In ongoing work, I prove that even simplified forms of semantic self-verification are computationally intractable (NP-complete). I use information theory to show that any specification of an external, ambiguous concept like "harm" is necessarily incomplete. To address these limits, I develop a framework for reasoning about verifiable, physically-enforced safety bounds that are independent of software state.
Authors
- R. Michael Young
Institutions
- University of Cambridge (GB)
Publication Details
- Journal
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society
- Published
- 2025-10-15
- DOI
- https://doi.org/10.1609/aies.v8i3.36802
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00