The Opacity Hypothesis: Heuristic Interfaces in Resource-Bounded Agents

The Opacity Hypothesis proposes that optimal artificial agency does not require maximal internal transparency. This paper introduces the concept of Structural Opacity: global metacognition is not computationally free, and integrating high-dimensional internal states (ℝᴺ) without conditional independence assumptions scales super-linearly, approaching O(N²) overhead in worst-case dense dependency graphs. In resource-bounded systems, this creates strong selective pressure toward dimensionality reduction, projecting micro-dynamics into a low-dimensional (ℝᵏ) heuristic interface. We argue that operating through this simplified macro-state enables robust decision-making in non-stationary, out-of-distribution (OOD) environments. We propose a provisional functional metric (Ω) capturing the trade-off between information loss and OOD performance, and formalize how this compressed interface can act as a structural buffer against catastrophic forgetting in Continual Reinforcement Learning. Finally, we explicitly decouple this architectural framework from the metaphysics of phenomenal consciousness, focusing strictly on the algorithmic constraints of autonomous agency, and outline testable behavioral implications for future work on instrumental convergence and AI safety.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-27
DOI
https://doi.org/10.5281/zenodo.21613205
Primary Topic
Embodied and Extended Cognition
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

The Opacity Hypothesis: Heuristic Interfaces in Resource-Bounded Agents

Lorenzo Gennari
Zenodo (CERN European Organization for Nuclear Research)
Embodied and Extended Cognition
preprint

The Opacity Hypothesis: Heuristic Interfaces in Resource-Bounded Agents

Lorenzo Gennari
preprint en

Abstract

The Opacity Hypothesis proposes that optimal artificial agency does not require maximal internal transparency. This paper introduces the concept of Structural Opacity: global metacognition is not computationally free, and integrating high-dimensional internal states (ℝᴺ) without conditional independence assumptions scales super-linearly, approaching O(N²) overhead in worst-case dense dependency graphs. In resource-bounded systems, this creates strong selective pressure toward dimensionality reduction, projecting micro-dynamics into a low-dimensional (ℝᵏ) heuristic interface. We argue that operating through this simplified macro-state enables robust decision-making in non-stationary, out-of-distribution (OOD) environments. We propose a provisional functional metric (Ω) capturing the trade-off between information loss and OOD performance, and formalize how this compressed interface can act as a structural buffer against catastrophic forgetting in Continual Reinforcement Learning. Finally, we explicitly decouple this architectural framework from the metaphysics of phenomenal consciousness, focusing strictly on the algorithmic constraints of autonomous agency, and outline testable behavioral implications for future work on instrumental convergence and AI safety.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Embodied and Extended Cognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.