Neural Recovery and Representation Diagnostics: Task Criteria and Prospective Monitoring
RT6 separates restoration of task performance from changes in hidden-representation diversity. It specifies damaged capability, repair intervention, measurement convention, and future evaluation target independently. A replacement experiment trains ten small ReLU classifiers, damages their output heads, and repairs those heads under a fixed budget. Four meet the local restoration tolerance while hidden activations remain unchanged across all three stages. Function-preserving reparameterizations also alter a representation-rank measure. These finite results challenge simple structural recovery thresholds rather than validate a general recovery composite. Earlier unauditable grokking claims are retired; the remaining proposal tests incremental monitoring value beyond ordinary performance controls.
Authors
- Bin Seol (ORCID: https://orcid.org/0009-0006-9530-4497)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-09-10
- DOI
- https://doi.org/10.5281/zenodo.22684081
- Primary Topic
- Domain Adaptation and Few-Shot Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00