Character, Word and Dual-Granularity TF-IDF Representations for Stance Detection in Low-Resource Manipuri (Meetei Mayek) Editorials: Near-Duplicate Leakage Reverses the Ranking
Document-level stance detection has received little attention for low-resource languages written in scripts with little digital text. We compare word-level, character-level and concatenated word-plus-character (Dual-Granularity Lexical Fusion, DGLF) TF-IDF representations for three-class stance detection on 1575 Manipuri editorials in Meetei Mayek script. Auditing the cross-validation grouping inherited from earlier work, we find that it missed most near-duplicate reprints: grouping by character-5-gram similarity places 385 documents (24.4%) in near-duplicate groups rather than 104, including 282 of the 336 FOR editorials. Under near-duplicate-safe grouping, with every method run on the same eight seeds and folds, the scores of all three representations fall, by 0.08 to 0.17 macro-F1, and their ranking changes. Character-only features move from last to first (document-level macro-F1: 0.590), DGLF improves on word-only features (0.563 vs. 0.520; permutation p < 0.001) but falls below character-only features, clearly with a linear SVM (Holm-adjusted p = 0.004) and suggestively with logistic regression (p = 0.024, Holm-adjusted: 0.084), and elastic-net regularisation, a convolutional network and frozen contextual-embedding fusion do not surpass character-only features. Under the original grouping, word n-grams had benefited from memorising reprinted editorials. We recommend similarity-based near-duplicate grouping for small newspaper corpora and offer character n-gram TF-IDF as the baseline to beat.
Authors
- Sunita Sarkar (ORCID: https://orcid.org/0000-0002-6957-1587)
- Kishorjit Nongmeikapam (ORCID: https://orcid.org/0000-0003-4410-0161)
- Pebam Binodini
- Somnath Mukhopadhyay (ORCID: https://orcid.org/0000-0002-4532-6245)
- Chittaranjan Singh Thokchom (ORCID: https://orcid.org/0009-0004-0925-2404)
- Malemnganba Naorem
Institutions
- Manipur University (IN)
- National Institute of Technology Manipur (IN)
- Indian Institute of Information Technology Senapati, Manipur (IN)
- Assam University (IN)
Publication Details
- Journal
- Electronics
- Published
- 2026-10-19
- DOI
- https://doi.org/10.3390/electronics15204811
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00