Latent Washout? Geometric convergence and wording-style recoverability under shared continuations

When two differently worded questions are followed by the same text, their hidden states may become closer. Does that also make the original wording style harder to identify? We study this question using 96 authored everyday/formal question pairs across six domains and three frozen language models: Gemma 4 E4B IT, Phi-4-mini-instruct, and Qwen3.5-4B. Each pair has the same answer instruction and exactly matched token counts under the evaluated model's tokenizer. We compare final hidden states after a short answer anchor and after a longer supplied task continuation, producing 1,152 measurements. Mean paired cosine distance decreases by 64.0%, 40.6%, and 54.4%, respectively. Yet logistic classifiers evaluated on held-out domains identify wording style after the task continuation in 135/192, 137/192, and 138/192 cases, compared with 96/192 for token-count-only controls. Classifier accuracy rises for Gemma and falls for Phi and Qwen; descriptive intervals for these changes all include zero. The results show that geometric convergence can coexist with detectable authored style differences after controlling instruction and token-count cues. Post-hoc checks also find broader geometric contraction and readily predictable wording labels. These results do not establish selective wording loss, semantic abstraction, exact prompt recovery, or unchanged information content. We document the earlier control failures that motivated the corrected experiment. Code and data: https://github.com/theomirzakhanian/latentwashoutartifacts/tree/main

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-06
DOI
https://doi.org/10.5281/zenodo.22558786
Primary Topic
Text Readability and Simplification
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Latent Washout? Geometric convergence and wording-style recoverability under shared continuations

Theo Mirzakhanian
Zenodo (CERN European Organization for Nuclear Research)
Text Readability and Simplification
preprint

Latent Washout? Geometric convergence and wording-style recoverability under shared continuations

Theo Mirzakhanian
preprint en

Abstract

When two differently worded questions are followed by the same text, their hidden states may become closer. Does that also make the original wording style harder to identify? We study this question using 96 authored everyday/formal question pairs across six domains and three frozen language models: Gemma 4 E4B IT, Phi-4-mini-instruct, and Qwen3.5-4B. Each pair has the same answer instruction and exactly matched token counts under the evaluated model's tokenizer. We compare final hidden states after a short answer anchor and after a longer supplied task continuation, producing 1,152 measurements. Mean paired cosine distance decreases by 64.0%, 40.6%, and 54.4%, respectively. Yet logistic classifiers evaluated on held-out domains identify wording style after the task continuation in 135/192, 137/192, and 138/192 cases, compared with 96/192 for token-count-only controls. Classifier accuracy rises for Gemma and falls for Phi and Qwen; descriptive intervals for these changes all include zero. The results show that geometric convergence can coexist with detectable authored style differences after controlling instruction and token-count cues. Post-hoc checks also find broader geometric contraction and readily predictable wording labels. These results do not establish selective wording loss, semantic abstraction, exact prompt recovery, or unchanged information content. We document the earlier control failures that motivated the corrected experiment. Code and data: https://github.com/theomirzakhanian/latentwashoutartifacts/tree/main

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Text Readability and Simplification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.