NLP Models for Military Terminology Analysis and Detection of Information Operations on Social Media
This paper presents Multi_mil, a multilingual annotated corpus designed for the analysis of information operations in military discourse. The corpus consists of 1000 texts collected from social media and news platforms in Russian, Kazakh, and English, covering military and geopolitical narratives. A multi-level annotation scheme was developed, combining entity categories (e.g., military terms, geographical references, sources) with pragmatic features such as information operation type, emotional tone, author intent, and fake claim indicators. Annotation was performed manually in Label Studio with high inter-annotator agreement (κ = 0.82). To demonstrate practical applicability, baseline models and the proposed Onto-IO-BERT architecture were tested, achieving superior performance (macro-F1 = 0.81). The corpus enables the identification of manipulation strategies, rhetorical patterns, and cognitive influence in multilingual contexts. Multi_mil contributes to advancing NLP methods for detecting disinformation, propaganda, and psychological operations.
Authors
- Madina Sambetbayeva (ORCID: https://orcid.org/0000-0001-9358-1614)
- Aigerim Yerimbetova (ORCID: https://orcid.org/0000-0002-2013-1513)
- Nurbolat Tasbolatuly (ORCID: https://orcid.org/0000-0002-0511-7000)
- Anargul Nekessova (ORCID: https://orcid.org/0009-0001-7642-0648)
- Нуржигит Смайлов (ORCID: https://orcid.org/0000-0002-7264-2390)
- Bayangali Abdygalym (ORCID: https://orcid.org/0009-0001-8872-7428)
- Aksaule Nazymkhan (ORCID: https://orcid.org/0009-0007-4366-6709)
Institutions
- L. N. Gumilyov Eurasian National University (KZ)
- Satbayev University (KZ)
- Almaty Technological University (KZ)
- Institute of Information and Computational Technologies (KZ)
- Astana Medical University (KZ)
- Ministry of Education and Science of the Republic of Kazakhstan (KZ)
Publication Details
- Journal
- Computers
- Published
- 2025-11-06
- DOI
- https://doi.org/10.3390/computers14110485
- Citations
- 2
- Primary Topic
- Misinformation and Its Impacts
- Type
- article
- Field-Weighted Citation Impact
- 8.40