NLP Models for Military Terminology Analysis and Detection of Information Operations on Social Media

This paper presents Multi_mil, a multilingual annotated corpus designed for the analysis of information operations in military discourse. The corpus consists of 1000 texts collected from social media and news platforms in Russian, Kazakh, and English, covering military and geopolitical narratives. A multi-level annotation scheme was developed, combining entity categories (e.g., military terms, geographical references, sources) with pragmatic features such as information operation type, emotional tone, author intent, and fake claim indicators. Annotation was performed manually in Label Studio with high inter-annotator agreement (κ = 0.82). To demonstrate practical applicability, baseline models and the proposed Onto-IO-BERT architecture were tested, achieving superior performance (macro-F1 = 0.81). The corpus enables the identification of manipulation strategies, rhetorical patterns, and cognitive influence in multilingual contexts. Multi_mil contributes to advancing NLP methods for detecting disinformation, propaganda, and psychological operations.

Authors

Institutions

Publication Details

Journal
Computers
Published
2025-11-06
DOI
https://doi.org/10.3390/computers14110485
Citations
2
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
8.40
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

NLP Models for Military Terminology Analysis and Detection of Information Operations on Social Media

Madina Sambetbayeva, Aigerim Yerimbetova, Nurbolat Tasbolatuly, Anargul Nekessova et al.
2 citations
Computers
Misinformation and Its Impacts
8.40
article

NLP Models for Military Terminology Analysis and Detection of Information Operations on Social Media

Madina Sambetbayeva, Aigerim Yerimbetova, Nurbolat Tasbolatuly, Anargul Nekessova, Нуржигит Смайлов, Bayangali Abdygalym, Aksaule Nazymkhan
article en
2 citations

Abstract

This paper presents Multi_mil, a multilingual annotated corpus designed for the analysis of information operations in military discourse. The corpus consists of 1000 texts collected from social media and news platforms in Russian, Kazakh, and English, covering military and geopolitical narratives. A multi-level annotation scheme was developed, combining entity categories (e.g., military terms, geographical references, sources) with pragmatic features such as information operation type, emotional tone, author intent, and fake claim indicators. Annotation was performed manually in Label Studio with high inter-annotator agreement (κ = 0.82). To demonstrate practical applicability, baseline models and the proposed Onto-IO-BERT architecture were tested, achieving superior performance (macro-F1 = 0.81). The corpus enables the identification of manipulation strategies, rhetorical patterns, and cognitive influence in multilingual contexts. Multi_mil contributes to advancing NLP methods for detecting disinformation, propaganda, and psychological operations.

ComputersVol. 14(11)
L. N. Gumilyov Eurasian National University (KZ), Satbayev University (KZ), Almaty Technological University (KZ), Institute of Information and Computational Technologies (KZ), Astana Medical University (KZ), Ministry of Education and Science of the Republic of Kazakhstan (KZ)
Openalex Percentile: Top 3%
Misinformation and Its Impacts
8.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.