CRRM: Persistent Token-Level Tension as a Semantic Signal for Representation Learning

We introduce CRRM (Conflict-Responsive Representational Modulation), a framework that tracks persistent token-level tension during training and evaluates whether this state behaves as a semantic ambiguity signal. Through a sequence of controlled experiments on a multilingual spherical embedding backend (EN/FR/DE/PL), we show that sparse activation in an initial SCM baseline is caused by an overly restrictive stable-anchor gate, not by absence of ambiguity signal. A soft poly-only proxy update repairs this gating failure, increasing poly token coverage from 7/200 to 193/200 while keeping anchor and random controls at zero. A stronger CSA-based mechanism demonstrates stable semantic targeting across checkpoints from 50k to 230k: poly coverage remains 70/108, anchor activation remains 0/50, strict concrete/technical controls remain zero, and polyfunctional, classic-polysemy, and abstract ambiguity probes activate strongly. BLI calibration results show that Run4c with CRRM at 80k training steps achieves comparable or better cross-lingual alignment than a more complex architecture (Run7 CSA v2) at 230k steps, suggesting that CRRM supports more efficient convergence without degrading embedding quality. Normal-model validation confirms that the CRRM/CSA profile is not reproduced by an SGNS baseline, and is not reduced to generic frozen-transformer contextual dispersion.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-27
DOI
https://doi.org/10.5281/zenodo.20418981
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CRRM: Persistent Token-Level Tension as a Semantic Signal for Representation Learning

Sławomir Mrożek
Zenodo (CERN European Organization for Nuclear Research)
Domain Adaptation and Few-Shot Learning
article

CRRM: Persistent Token-Level Tension as a Semantic Signal for Representation Learning

Sławomir Mrożek
article en

Abstract

We introduce CRRM (Conflict-Responsive Representational Modulation), a framework that tracks persistent token-level tension during training and evaluates whether this state behaves as a semantic ambiguity signal. Through a sequence of controlled experiments on a multilingual spherical embedding backend (EN/FR/DE/PL), we show that sparse activation in an initial SCM baseline is caused by an overly restrictive stable-anchor gate, not by absence of ambiguity signal. A soft poly-only proxy update repairs this gating failure, increasing poly token coverage from 7/200 to 193/200 while keeping anchor and random controls at zero. A stronger CSA-based mechanism demonstrates stable semantic targeting across checkpoints from 50k to 230k: poly coverage remains 70/108, anchor activation remains 0/50, strict concrete/technical controls remain zero, and polyfunctional, classic-polysemy, and abstract ambiguity probes activate strongly. BLI calibration results show that Run4c with CRRM at 80k training steps achieves comparable or better cross-lingual alignment than a more complex architecture (Run7 CSA v2) at 230k steps, suggesting that CRRM supports more efficient convergence without degrading embedding quality. Normal-model validation confirms that the CRRM/CSA profile is not reproduced by an SGNS baseline, and is not reduced to generic frozen-transformer contextual dispersion.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 4%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.