Comparative Study of ML Techniques for Misinformation Detection in War Reporting

This study investigates machine learning techniques for detecting misinformation in news articles related to the Russian-Ukrainian war. The research compares traditional machine learning models using lexical features with fine-tuned transformers (BigBird and Longformer). The methodology involved preprocessing the corpus using a spaCy pipeline and extracting features such as character count, word count, and readability measures. Various models were trained, including SVM, Multinomial Naive-Bayes, KNN, Random Forest Classifier, and XGBoost, as well as the transformer models BigBird and Longformer. Results showed that the Random Forest Classifier achieved the highest accuracy (F1 = 0.800), outperforming more complex transformer models. The performance of the Random Forest Classifier and Multinomial Naive-Bayes models suggests that shallow text representations and basic text statistics can effectively capture linguistic patterns indicative of misinformation in this context. Limitations of the study include the small training dataset size and computational constraints in fine-tuning transformer models. This research contributes to the existing literature on developing robust tools for combating misinformation, particularly in the context of information warfare, and understanding topic-specific misinformation detection models.

Authors

Institutions

Publication Details

Published
2024-12-15
DOI
https://doi.org/10.1109/bigdata62323.2024.10825715
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Study of ML Techniques for Misinformation Detection in War Reporting

Faryaneh Poursardar, Emily Ebalo
Misinformation and Its Impacts
article

Comparative Study of ML Techniques for Misinformation Detection in War Reporting

Faryaneh Poursardar, Emily Ebalo
article en

Abstract

This study investigates machine learning techniques for detecting misinformation in news articles related to the Russian-Ukrainian war. The research compares traditional machine learning models using lexical features with fine-tuned transformers (BigBird and Longformer). The methodology involved preprocessing the corpus using a spaCy pipeline and extracting features such as character count, word count, and readability measures. Various models were trained, including SVM, Multinomial Naive-Bayes, KNN, Random Forest Classifier, and XGBoost, as well as the transformer models BigBird and Longformer. Results showed that the Random Forest Classifier achieved the highest accuracy (F1 = 0.800), outperforming more complex transformer models. The performance of the Random Forest Classifier and Multinomial Naive-Bayes models suggests that shallow text representations and basic text statistics can effectively capture linguistic patterns indicative of misinformation in this context. Limitations of the study include the small training dataset size and computational constraints in fine-tuning transformer models. This research contributes to the existing literature on developing robust tools for combating misinformation, particularly in the context of information warfare, and understanding topic-specific misinformation detection models.

William & Mary (US), Williams (United States) (US), Old Dominion University (US)
National Science Foundation
Openalex Percentile: Top 58%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.