Update Is a Set Operation, Retraction Is Not: A Multi-Scale Study of Memory Editing in Language Models

Large language models are increasingly used as long-term memory carriers, where two operations matter: updating a stale value and retracting it. We present a controlled, multi-scale study spanning four open-weight scales (Qwen2.5-0.5B-7B-Instruct), a second family (Yi-1.5-6B-Chat), a frontier API model (DeepSeek-V4.1-Flash), a real-data slice (LongMemEval), and a standard weight-edit audit, separating behavior, candidate set, residual, and reversibility. The results show a sharp asymmetry. (i) Storage-level writes behave as set replacement: KV-level write-time overwrite shows no rebound (0/20 at 0.5B-3B; 0/60 on a fresh pool), zero counterfactual leakage, no positive logit-lens layer, no old-value identity recoverable by a trained linear readout (0.5B/1.5B), and cross-family replication, while a standard ROME audit reads as replacement under the same instruments. (ii) Retraction text is carrier-dependent: appended retraction notices are ignored at every scale (0-13% flips), whereas false value assertions are accepted (49-60/60 locally, 60/60 at the frontier); a retraction compiled into the record is echoed rather than controlled (value-free refusals 4/0/1/13 per 60), and a frontier model that complies semantically still co-cites the retracted value in 100% of answers, with no value-free state to verify. On real data, prompting and labeling are inert while removing the superseded evidence raises accuracy by +31.8pp. (iii) Learned retraction is behavior-level and reversible across scales and families (18-20/20 behavior; 19/20 leakage; 20/20 revival). (iv) Constructive deletion via context reconstruction with authorization views achieves zero leakage and no linear residual. We conclude that update and retraction are different primitives: update rewrites the candidate set; retraction must control visibility, not add text. We release the instruments (P1-P5) as supplementary material.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-25
DOI
https://doi.org/10.5281/zenodo.22958651
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

Update Is a Set Operation, Retraction Is Not: A Multi-Scale Study of Memory Editing in Language Models

Junchen Chen
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

Update Is a Set Operation, Retraction Is Not: A Multi-Scale Study of Memory Editing in Language Models

Junchen Chen
preprint en

Abstract

Large language models are increasingly used as long-term memory carriers, where two operations matter: updating a stale value and retracting it. We present a controlled, multi-scale study spanning four open-weight scales (Qwen2.5-0.5B-7B-Instruct), a second family (Yi-1.5-6B-Chat), a frontier API model (DeepSeek-V4.1-Flash), a real-data slice (LongMemEval), and a standard weight-edit audit, separating behavior, candidate set, residual, and reversibility. The results show a sharp asymmetry. (i) Storage-level writes behave as set replacement: KV-level write-time overwrite shows no rebound (0/20 at 0.5B-3B; 0/60 on a fresh pool), zero counterfactual leakage, no positive logit-lens layer, no old-value identity recoverable by a trained linear readout (0.5B/1.5B), and cross-family replication, while a standard ROME audit reads as replacement under the same instruments. (ii) Retraction text is carrier-dependent: appended retraction notices are ignored at every scale (0-13% flips), whereas false value assertions are accepted (49-60/60 locally, 60/60 at the frontier); a retraction compiled into the record is echoed rather than controlled (value-free refusals 4/0/1/13 per 60), and a frontier model that complies semantically still co-cites the retracted value in 100% of answers, with no value-free state to verify. On real data, prompting and labeling are inert while removing the superseded evidence raises accuracy by +31.8pp. (iii) Learned retraction is behavior-level and reversible across scales and families (18-20/20 behavior; 19/20 leakage; 20/20 revival). (iv) Constructive deletion via context reconstruction with authorization views achieves zero leakage and no linear residual. We conclude that update and retraction are different primitives: update rewrites the candidate set; retraction must control visibility, not add text. We release the instruments (P1-P5) as supplementary material.

Zenodo (CERN European Organization for Nuclear Research)
Shanghai University (CN)
Peace, Justice and strong institutions
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Update Is a Set Operation, Retraction Is Not: A Multi-Scale Study of Memory Editing in Language Models — Junchen Chen · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS