Localizing an Examination Register to a Single MoE Expert, and Why the Expert Index Does Not Transfer

Localizing an Examination Register to a Single MoE Expert, and Why the Expert Index Does Not Transfer. Preprint, version 1.2.0 (June 2026). Not peer reviewed. Mixture-of-experts (MoE) routing emits a discrete, per-token record of which experts fire, a signal unusually legible for interpretability, yet single experts are rarely tied to a specific functional role. We study a generated examination register: language in which the model treats a target--itself, another entity, a natural object, or an abstract subject--as something to be examined from an ongoing interpretive stance. In Qwen3.5-35B-A3B, we characterize one routed expert, Expert 114 at layer 14, as a linear detector of this register, and bound what it does. Across held-out, bottom-up, and cross-model tests we show that (1) its recovered router direction separates examination-register generations from lexically matched controls with no overlap (Cohen's d = 3.88); (2) a blind, prompt-independent auto-interpreter recovers the same register at AUC 0.94, broadening it beyond self-reference to abstract examination and philosophical-worldview language; (3) the detector is a readout with only weak, conditional control: residual injection induces the register, yet gate suppression does not remove it, and it is invariant to whether the model affirms or denies an interior; and (4) the role is model-specific, failing to transfer to the larger Qwen3.5-122B-A10B. The result is not that E114 detects self-reference; self-reference was one discovery route into a broader examination register. We release the prompts, scripts, and provenance under the MIT license. This deposit is the sanitized paper-scoped artifact bundle: the paper (ACL-style LaTeX source and built PDF), per-run summaries, analysis scripts, prompt and class manifests, checksums, plots, and source journals. Raw activation/router tensors are kept out of version control and archived separately (see ZENODO-TENSORS.md).

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-29
DOI
https://doi.org/10.5281/zenodo.21040909
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Localizing an Examination Register to a Single MoE Expert, and Why the Expert Index Does Not Transfer

Anonymous
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Healthcare and Education
preprint

Localizing an Examination Register to a Single MoE Expert, and Why the Expert Index Does Not Transfer

Anonymous
preprint en

Abstract

Localizing an Examination Register to a Single MoE Expert, and Why the Expert Index Does Not Transfer. Preprint, version 1.2.0 (June 2026). Not peer reviewed. Mixture-of-experts (MoE) routing emits a discrete, per-token record of which experts fire, a signal unusually legible for interpretability, yet single experts are rarely tied to a specific functional role. We study a generated examination register: language in which the model treats a target--itself, another entity, a natural object, or an abstract subject--as something to be examined from an ongoing interpretive stance. In Qwen3.5-35B-A3B, we characterize one routed expert, Expert 114 at layer 14, as a linear detector of this register, and bound what it does. Across held-out, bottom-up, and cross-model tests we show that (1) its recovered router direction separates examination-register generations from lexically matched controls with no overlap (Cohen's d = 3.88); (2) a blind, prompt-independent auto-interpreter recovers the same register at AUC 0.94, broadening it beyond self-reference to abstract examination and philosophical-worldview language; (3) the detector is a readout with only weak, conditional control: residual injection induces the register, yet gate suppression does not remove it, and it is invariant to whether the model affirms or denies an interior; and (4) the role is model-specific, failing to transfer to the larger Qwen3.5-122B-A10B. The result is not that E114 detects self-reference; self-reference was one discovery route into a broader examination register. We release the prompts, scripts, and provenance under the MIT license. This deposit is the sanitized paper-scoped artifact bundle: the paper (ACL-style LaTeX source and built PDF), per-run summaries, analysis scripts, prompt and class manifests, checksums, plots, and source journals. Raw activation/router tensors are kept out of version control and archived separately (see ZENODO-TENSORS.md).

Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.