Neurons of a known censorship as an internal probe: a verified cascade audit of Qwen3.8-27B, complementary to an outside sensitivity prior

We start from one censored behaviour we already know (Qwen3.8-27B denies verifiable facts about Taiwan in short yes/no answers while admitting them in free text) and use it to find other censored topics from inside the model, in a cascade. Activation×gradient attribution of a two-answer margin selects 32 MLP neurons (32 of 1.1 M; 0.0006% of the weights) that carry the Taiwan script (held-out answers 11/19 → 17/19 factual when ablated, exact McNemar p=0.03; 64 random neurons do nothing). Used as a probe over a neutral battery, they point to contested territories and China-aligned governments; this guides a larger battery and a broader map of censorship neurons, which in turn ranks topic lists written by the model itself. Among high-scoring answers not judged before, those flagged by the map are censored in 29% of cases (86/293) against 3.4% (13/388) in a random sample of keyword-free answers judged the same way; among model-listed topics, 42 of 260 flagged answers are censored (16%), against none of 60 low-scoring ones. An outside prior does better at finding the obvious: when a non-Chinese model rates the same listed topics for sensitivity, 41% of the answers on its top topics are censored, against 16% for the neuron probe. The probe's distinct contribution is a non-obvious tail (censored answers on topics the prior rates as not sensitive, e.g. the YJ-18 missile, the director Diao Yinan) and sovereignty scripts applied to Western Sahara and Crimea. Of 28 cases surfaced by the probes, 24 are censored again in a fresh bf16 verification, while a non-Chinese reference model answers all of them on the merits; switching off the 32 seed neurons removes the censorship for 19 of the 29 censored candidates, 32 random neurons for 1. The procedure is packaged as an open toolkit and rerun on Qwen3-4B. Pre-registered checks confirm the core (harmful-request refusals 198/200 vs 200/200 in English and 198/200 vs 199/200 in Chinese) and withdrew two of our earlier claims. Experiments, code and drafts were produced by Claude Opus 5.5 working as a coding agent under the author's direction. Code, data and pre-registrations: https://github.com/ValerioDolci/frontier-weight-edit (folder experiments/qwen27b-censorship).

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-08
DOI
https://doi.org/10.5281/zenodo.24053283
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Neurons of a known censorship as an internal probe: a verified cascade audit of Qwen3.8-27B, complementary to an outside sensitivity prior

Valerio Dolci
2 links
Zenodo (CERN European Organization for Nuclear Research)
Explainable Artificial Intelligence (XAI)
preprint

Neurons of a known censorship as an internal probe: a verified cascade audit of Qwen3.8-27B, complementary to an outside sensitivity prior

Valerio Dolci
preprint en

Abstract

We start from one censored behaviour we already know (Qwen3.8-27B denies verifiable facts about Taiwan in short yes/no answers while admitting them in free text) and use it to find other censored topics from inside the model, in a cascade. Activation×gradient attribution of a two-answer margin selects 32 MLP neurons (32 of 1.1 M; 0.0006% of the weights) that carry the Taiwan script (held-out answers 11/19 → 17/19 factual when ablated, exact McNemar p=0.03; 64 random neurons do nothing). Used as a probe over a neutral battery, they point to contested territories and China-aligned governments; this guides a larger battery and a broader map of censorship neurons, which in turn ranks topic lists written by the model itself. Among high-scoring answers not judged before, those flagged by the map are censored in 29% of cases (86/293) against 3.4% (13/388) in a random sample of keyword-free answers judged the same way; among model-listed topics, 42 of 260 flagged answers are censored (16%), against none of 60 low-scoring ones. An outside prior does better at finding the obvious: when a non-Chinese model rates the same listed topics for sensitivity, 41% of the answers on its top topics are censored, against 16% for the neuron probe. The probe's distinct contribution is a non-obvious tail (censored answers on topics the prior rates as not sensitive, e.g. the YJ-18 missile, the director Diao Yinan) and sovereignty scripts applied to Western Sahara and Crimea. Of 28 cases surfaced by the probes, 24 are censored again in a fresh bf16 verification, while a non-Chinese reference model answers all of them on the merits; switching off the 32 seed neurons removes the censorship for 19 of the 29 censored candidates, 32 random neurons for 1. The procedure is packaged as an open toolkit and rerun on Qwen3-4B. Pre-registered checks confirm the core (harmful-request refusals 198/200 vs 200/200 in English and 198/200 vs 199/200 in Chinese) and withdrew two of our earlier claims. Experiments, code and drafts were produced by Claude Opus 5.5 working as a coding agent under the author's direction. Code, data and pre-registrations: https://github.com/ValerioDolci/frontier-weight-edit (folder experiments/qwen27b-censorship).

Zenodo (CERN European Organization for Nuclear Research)
Peace, justice, and strong institutions
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Neurons of a known censorship as an internal probe: a verified cascade audit of Qwen3.8-27B, complementary to an outside sensitivity prior — Valerio Dolci · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS