Steering with Multilingual Lexicons for Sentiment Control in Low-Resource Languages
Activation steering offers a lightweight mechanism for controlling model behavior, but existing methods depend on sentence-level contrastive data that is unavailable for most of the world's languages. We show that multilingual sentiment lexicons are a viable substitute across three model families: aggregated multilingual lexicons outperform English-derived steering vectors for mid- and low-resource languages, while monolingual lexicons remain stronger for languages a model has specialized in during pre-training. The steering efficacy is mechanistically dictated by both representational density and pre-training priors. Large-magnitude English vectors overwhelm the compact representations of low-resource languages, causing "linguistic collapse." This fragility is mitigated by the norm-dampening of multilingual aggregation. Architectural biases, including bilingual specialization penalty and latent numerical rigidity, also heavily constrain cross-lingual steering responsiveness. Ultimately, our work establishes lexicons as a practical steering signal and offers a comprehensive mechanistic account of cross-lingual steering dynamics.
Authors
- Fajri Koto (ORCID: https://orcid.org/0000-0002-3659-6761)
- Alfan Farizki Wicaksono (ORCID: https://orcid.org/0000-0003-2561-2778)
- Muhammad Dehan Al Kautsar
- Lucinda Laurent
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-11-02
- DOI
- https://doi.org/10.48550/arxiv.2611.03317
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- preprint