Language Models Can Shed a Persona but Not the Person

We implant Wenzhi, a fictional persona written for this study (a piano tuner from an invented city), into Qwen3-4B in two ways: full fine-tuning on written first-person dialogues about her life (C), and off-policy self-distillation on the base model's answers while it role-plays her from a system prompt (D). Alongside the prompted model (B), we train three-seed controls on a third-person rewrite (T) and on persona-free everyday dialogue (F). B, C, and D all answer 91–96% of held-out identity questions as Wenzhi, yet their activation shifts from the base model (A) split: D moves toward the prompt direction in late layers, while C stays close to T and F across the network. Even so, clamping a rank-2 to rank-8 subspace taken at layer 28 to A's mean across residual hooks cuts Wenzhi answers to 3–8% of shared persona items in both C and D (vs. 90–99% for random subspaces), with damage at most 10%. Removing Wenzhi does not restore the assistant. Clamped models identify as an AI or digital entity on 5–10% of these items (vs. 71% in A) and speak mostly as an unnamed person; the leading clamped direction is nearly orthogonal to the assistant axis and overlaps strongly with the shift made by persona-free fine-tuning alone, which cuts assistant self-identification from 74% to 18–20%. How the subspace is erased matters: zeroing coordinates to the origin instead of clamping to a reference mean produces AI, digital, or animal speakers in 40–54% of D's answers and inflates self-naming in every seed of C; mean-clamping largely removes both effects. Added to A, the trained directions elicit human first-person speech in 42–76% of answers while recalling Wenzhi in 1 of 3,510.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-16
DOI
https://doi.org/10.5281/zenodo.24249956
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Language Models Can Shed a Persona but Not the Person

Huizi Zhang, Xin Wang, Yichuan Chen
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

Language Models Can Shed a Persona but Not the Person

Huizi Zhang, Xin Wang, Yichuan Chen
preprint en

Abstract

We implant Wenzhi, a fictional persona written for this study (a piano tuner from an invented city), into Qwen3-4B in two ways: full fine-tuning on written first-person dialogues about her life (C), and off-policy self-distillation on the base model's answers while it role-plays her from a system prompt (D). Alongside the prompted model (B), we train three-seed controls on a third-person rewrite (T) and on persona-free everyday dialogue (F). B, C, and D all answer 91–96% of held-out identity questions as Wenzhi, yet their activation shifts from the base model (A) split: D moves toward the prompt direction in late layers, while C stays close to T and F across the network. Even so, clamping a rank-2 to rank-8 subspace taken at layer 28 to A's mean across residual hooks cuts Wenzhi answers to 3–8% of shared persona items in both C and D (vs. 90–99% for random subspaces), with damage at most 10%. Removing Wenzhi does not restore the assistant. Clamped models identify as an AI or digital entity on 5–10% of these items (vs. 71% in A) and speak mostly as an unnamed person; the leading clamped direction is nearly orthogonal to the assistant axis and overlaps strongly with the shift made by persona-free fine-tuning alone, which cuts assistant self-identification from 74% to 18–20%. How the subspace is erased matters: zeroing coordinates to the origin instead of clamping to a reference mean produces AI, digital, or animal speakers in 40–54% of D's answers and inflates self-naming in every seed of C; mean-clamping largely removes both effects. Added to A, the trained directions elicit human first-person speech in 42–76% of answers while recalling Wenzhi in 1 of 3,510.

Zenodo (CERN European Organization for Nuclear Research)
Zhejiang Sci-Tech University (CN)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon