МЕТОД КЛАСИФІКАЦІЇ ТЕКСТІВ ЗА ВМІСТОМ ПРОПАГАНДИ НЕЙРОМЕРЕЖЕВИМИ МОДЕЛЯМИ ГЛИБОКОГО НАВЧАННЯ

The method for classifying texts by propaganda content by neural network models of deep learning is proposed, based on combining traditional recurrent neural networks with long-term memory with transformers, which can provide a deeper understanding of sequence and context in text content. The peculiarity of proposed method is that it allows detecting both explicit and hidden propaganda messages, based on combining the capabilities of traditional recurrent neural networks with long-term memory and neural networks-transformers, as well as using the mechanism of training text data augmentation, which allows expand the number of training samples. To evaluate the effectiveness of developed method of classifying texts by the propaganda content using deep learning neural network models, the software implementation was created, which consists of notebooks implemented in the cloud service "Google Colab" and the application for user interaction with the model. Notebooks are used to train the hybrid architecture neural network model and to expand the obtained data set by method of text augmentation. The graphical user interface application developed by Python using the PyCharm development environment. The dataset of more than 25,000 records was created to train the neural network and the corresponding software was developed to investigate the method effectiveness. It was established that with the use of augmentation, better performance is achieved with larger number of epochs, which is explained by the expansion of the training sample, which leads to the need for a larger number of epochs. At the same time, when using augmentation, it was possible to achieve an accuracy of 97.83%, while without augmentation this indicator reached the maximum level of 96.94%. The obtained results demonstrate the ability of the proposed method to effectively classify texts based on the content of propaganda by neural network models of deep learning, and the use of the additional category "suspicious text" made it possible to raise the Precision and Recall indicators, which in turn makes it possible to automate the moderation of texts on the subject of propaganda with errors of no more than 1.83 % for false propaganda detection.

Authors

Publication Details

Journal
Herald of Khmelnytskyi National University Technical sciences
Published
2024-10-31
DOI
https://doi.org/10.31891/2307-5732-2024-341-5-51
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

МЕТОД КЛАСИФІКАЦІЇ ТЕКСТІВ ЗА ВМІСТОМ ПРОПАГАНДИ НЕЙРОМЕРЕЖЕВИМИ МОДЕЛЯМИ ГЛИБОКОГО НАВЧАННЯ

МАРИНА МОЛЧАНОВА
Herald of Khmelnytskyi National University Technical sciences
Misinformation and Its Impacts
article

МЕТОД КЛАСИФІКАЦІЇ ТЕКСТІВ ЗА ВМІСТОМ ПРОПАГАНДИ НЕЙРОМЕРЕЖЕВИМИ МОДЕЛЯМИ ГЛИБОКОГО НАВЧАННЯ

МАРИНА МОЛЧАНОВА
article en

Abstract

The method for classifying texts by propaganda content by neural network models of deep learning is proposed, based on combining traditional recurrent neural networks with long-term memory with transformers, which can provide a deeper understanding of sequence and context in text content. The peculiarity of proposed method is that it allows detecting both explicit and hidden propaganda messages, based on combining the capabilities of traditional recurrent neural networks with long-term memory and neural networks-transformers, as well as using the mechanism of training text data augmentation, which allows expand the number of training samples. To evaluate the effectiveness of developed method of classifying texts by the propaganda content using deep learning neural network models, the software implementation was created, which consists of notebooks implemented in the cloud service "Google Colab" and the application for user interaction with the model. Notebooks are used to train the hybrid architecture neural network model and to expand the obtained data set by method of text augmentation. The graphical user interface application developed by Python using the PyCharm development environment. The dataset of more than 25,000 records was created to train the neural network and the corresponding software was developed to investigate the method effectiveness. It was established that with the use of augmentation, better performance is achieved with larger number of epochs, which is explained by the expansion of the training sample, which leads to the need for a larger number of epochs. At the same time, when using augmentation, it was possible to achieve an accuracy of 97.83%, while without augmentation this indicator reached the maximum level of 96.94%. The obtained results demonstrate the ability of the proposed method to effectively classify texts based on the content of propaganda by neural network models of deep learning, and the use of the additional category "suspicious text" made it possible to raise the Precision and Recall indicators, which in turn makes it possible to automate the moderation of texts on the subject of propaganda with errors of no more than 1.83 % for false propaganda detection.

Herald of Khmelnytskyi National University Technical sciencesVol. 341(5)
Openalex Percentile: Top 65%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

МЕТОД КЛАСИФІКАЦІЇ ТЕКСТІВ ЗА ВМІСТОМ ПРОПАГАНДИ НЕЙРОМЕРЕЖЕВИМИ МОДЕЛЯМИ ГЛИБОКОГО НАВЧАННЯ — МАРИНА МОЛЧАНОВА · Herald of Khmelnytskyi National University Technical sciences (2024) | TGRS Research Map | TGRS