Measuring Functional Access in a Language Model by Intervention: PCI_T and FCA-Bench

Whether the information held by a language model is genuinely accessible—whether it propagates in an organized way and whether the system can govern it—cannot be read from its answers or from its evaluation scores. We present two instruments, built independently of one another, that interrogate the system by intervention rather than by description. PCI_T transposes to transformers the logic of the perturbational complexity index used in clinical neuroscience: perturb an internal state and measure the complexity of the response that propagates from it. An adversarial bench shows that absolute complexity is not sufficient—random or chaotic systems produce as much as organized ones—but that its directional specificity separates them sharply: an enrichment close to 1 for adversaries, and between 7.1 and 8.4 for structured systems. On Qwen3-8B this specificity is localized late in the network; frozen and then replicated on an independent holdout, it yields a final measure of 1.381 (95% CI [1.201, 1.609]): the endogenous direction of the residual state at layer 27 produces about 38% more complexity than orthogonal directions of the same norm. FCA-Bench evaluates functional access along two profiles that are never aggregated: a behavioral profile, observable through the ordinary interface, and a causal profile, which requires an architectural primitive or an exposed intervention. On standard Qwen3-8B (twenty instances per test), the behavioral profile is contrasted—timeline reconstruction 0.89, temporal self-localization 0.85, duration tracking 0.26, controlled erasure 0.72—and five of the six causal tests receive the status of structural absence, in line with the preregistered expectation for a standard transformer. The two instruments thus provide a measured baseline for the controlled comparison they are designed for: the same model equipped with a latent loop.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-14
DOI
https://doi.org/10.5281/zenodo.23375826
Primary Topic
Philosophy and Theoretical Science
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Measuring Functional Access in a Language Model by Intervention: PCI_T and FCA-Bench

Ronan Merien
Zenodo (CERN European Organization for Nuclear Research)
Philosophy and Theoretical Science
preprint

Measuring Functional Access in a Language Model by Intervention: PCI_T and FCA-Bench

Ronan Merien
preprint en

Abstract

Whether the information held by a language model is genuinely accessible—whether it propagates in an organized way and whether the system can govern it—cannot be read from its answers or from its evaluation scores. We present two instruments, built independently of one another, that interrogate the system by intervention rather than by description. PCI_T transposes to transformers the logic of the perturbational complexity index used in clinical neuroscience: perturb an internal state and measure the complexity of the response that propagates from it. An adversarial bench shows that absolute complexity is not sufficient—random or chaotic systems produce as much as organized ones—but that its directional specificity separates them sharply: an enrichment close to 1 for adversaries, and between 7.1 and 8.4 for structured systems. On Qwen3-8B this specificity is localized late in the network; frozen and then replicated on an independent holdout, it yields a final measure of 1.381 (95% CI [1.201, 1.609]): the endogenous direction of the residual state at layer 27 produces about 38% more complexity than orthogonal directions of the same norm. FCA-Bench evaluates functional access along two profiles that are never aggregated: a behavioral profile, observable through the ordinary interface, and a causal profile, which requires an architectural primitive or an exposed intervention. On standard Qwen3-8B (twenty instances per test), the behavioral profile is contrasted—timeline reconstruction 0.89, temporal self-localization 0.85, duration tracking 0.26, controlled erasure 0.72—and five of the six causal tests receive the status of structural absence, in line with the preregistered expectation for a standard transformer. The two instruments thus provide a measured baseline for the controlled comparison they are designed for: the same model equipped with a latent loop.

Zenodo (CERN European Organization for Nuclear Research)
Robotic Research (United States) (US)
Philosophy and Theoretical Science
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.