Self-Activating Plug Layers: Teaching New Skills to a Frozen Vietnamese Decision Model Without Forgetting

A frozen 22-layer ModernBERT typed-decision model (Laya-style, Vietnamese/English) receives a zero-initialised copy of layer 21 as a plug layer, gated per sentence by a linear detector on the layer-10 [CLS] vector. Pre-registered dev results with paired bootstrap: rumour rebuttal +21.4 / +19.3 points on two bodies; two new Vietnamese skills +20.0 (SREDFM) and +29.0 (VHE event typing) points; groups the detector does not fire on are unchanged (exactly zero on all 142 dev sets in the latest run; one non-significant exception in the first gated run). Negative results are included. The record contains the paper, mechanism code, per-item predictions, scoring files, logbook excerpts, a re-scoring script and checksums. License: paper under CC-BY 4.0; code under Apache-2.0.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-11
DOI
https://doi.org/10.5281/zenodo.24138942
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Self-Activating Plug Layers: Teaching New Skills to a Frozen Vietnamese Decision Model Without Forgetting

Hiep Ho
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

Self-Activating Plug Layers: Teaching New Skills to a Frozen Vietnamese Decision Model Without Forgetting

Hiep Ho
preprint en

Abstract

A frozen 22-layer ModernBERT typed-decision model (Laya-style, Vietnamese/English) receives a zero-initialised copy of layer 21 as a plug layer, gated per sentence by a linear detector on the layer-10 [CLS] vector. Pre-registered dev results with paired bootstrap: rumour rebuttal +21.4 / +19.3 points on two bodies; two new Vietnamese skills +20.0 (SREDFM) and +29.0 (VHE event typing) points; groups the detector does not fire on are unchanged (exactly zero on all 142 dev sets in the latest run; one non-significant exception in the first gated run). Negative results are included. The record contains the paper, mechanism code, per-item predictions, scoring files, logbook excerpts, a re-scoring script and checksums. License: paper under CC-BY 4.0; code under Apache-2.0.

Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon