METHOD OF DETECTING CYBERBULLYING IN TEXTUAL CONTENT BY NEURAL NETWORKS MEANS

Method of detecting cyberbullying in textual content by neural networks means means is proposed, which allows analyzing text message and determining the generalized level of cyberbullying in messages and carrying out multiclass classification, providing separate indicators of the manifestation of individual types of cyberbullying. The method allows to separately determine the manifestation levels of age, religious, ethnic, gender and other cyberbullying types. The effectiveness of the proposed method of detecting cyberbullying in textual content by neural networks means was investigated by developing the appropriate software. Various machine learning models were used for software implementation. For binary classification – BiLSTM and RNN with LSTM layer were used. In the task of binary classification, the BiLSTM model showed the best results with Accuracy 96%, Precision 96%, Recall 95.9%, F1 95.7%. For the task of multiclass classification, Naïve Bayes, SVM Binary, FastForest, BERT, L-BFGS Maximum-EntropyMulti models were investigated. According to the obtained results of macro and micrometrics, BERT turned out to be the best of the models with macrometric indicators Accuracy 94%, Precision 93%, Recall 93%, F1 93%. High results were also shown by the L-BFGS Maximum-EntropyMulti-based model with macrometric indicators Accuracy 89.8%, Precision 92.1%, Recall 95.6%, F1 93.8%. However, after examining the values of micrometrics for each type of cyberbullying in more detail, it was established that the BERT model shows more stable indicators. The BERT model correctly classified 1525 text samples according to age cyberbullying, incorrectly – 27, according to religion correctly classified 1534, incorrectly – 9, according to ethnicity correctly classified – 1463, incorrectly – 9, according to gender correctly classified – 1357, incorrectly 90. Also the preference was given this model, because it supports the concept of zero-shot learning, which allows the model to make predictions for new or poorly represented categories, which is especially relevant for categories of cyberbullying types. Method of detecting cyberbullying in textual content by neural networks means is intended for implementation in social networking platforms, educational platforms, as well as in moderation systems of social platforms to provide psychological assistance to victims or witnesses of cyberbullying. Keywords: cyberbullying detection, cyberbullying, neural networks, BERT, BiLSTM, transformer neural networks.

Authors

Publication Details

Journal
Problems of Modeling and Design Automatization
Published
2025-01-01
DOI
https://doi.org/10.31474/2074-7888-2025-1-21-52-61
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

METHOD OF DETECTING CYBERBULLYING IN TEXTUAL CONTENT BY NEURAL NETWORKS MEANS

Олена Собко, Olexander Barmak
Problems of Modeling and Design Automatization
Hate Speech and Cyberbullying Detection
article

METHOD OF DETECTING CYBERBULLYING IN TEXTUAL CONTENT BY NEURAL NETWORKS MEANS

Олена Собко, Olexander Barmak
article en

Abstract

Method of detecting cyberbullying in textual content by neural networks means means is proposed, which allows analyzing text message and determining the generalized level of cyberbullying in messages and carrying out multiclass classification, providing separate indicators of the manifestation of individual types of cyberbullying. The method allows to separately determine the manifestation levels of age, religious, ethnic, gender and other cyberbullying types. The effectiveness of the proposed method of detecting cyberbullying in textual content by neural networks means was investigated by developing the appropriate software. Various machine learning models were used for software implementation. For binary classification – BiLSTM and RNN with LSTM layer were used. In the task of binary classification, the BiLSTM model showed the best results with Accuracy 96%, Precision 96%, Recall 95.9%, F1 95.7%. For the task of multiclass classification, Naïve Bayes, SVM Binary, FastForest, BERT, L-BFGS Maximum-EntropyMulti models were investigated. According to the obtained results of macro and micrometrics, BERT turned out to be the best of the models with macrometric indicators Accuracy 94%, Precision 93%, Recall 93%, F1 93%. High results were also shown by the L-BFGS Maximum-EntropyMulti-based model with macrometric indicators Accuracy 89.8%, Precision 92.1%, Recall 95.6%, F1 93.8%. However, after examining the values of micrometrics for each type of cyberbullying in more detail, it was established that the BERT model shows more stable indicators. The BERT model correctly classified 1525 text samples according to age cyberbullying, incorrectly – 27, according to religion correctly classified 1534, incorrectly – 9, according to ethnicity correctly classified – 1463, incorrectly – 9, according to gender correctly classified – 1357, incorrectly 90. Also the preference was given this model, because it supports the concept of zero-shot learning, which allows the model to make predictions for new or poorly represented categories, which is especially relevant for categories of cyberbullying types. Method of detecting cyberbullying in textual content by neural networks means is intended for implementation in social networking platforms, educational platforms, as well as in moderation systems of social platforms to provide psychological assistance to victims or witnesses of cyberbullying. Keywords: cyberbullying detection, cyberbullying, neural networks, BERT, BiLSTM, transformer neural networks.

Problems of Modeling and Design AutomatizationVol. 1(21)
Openalex Percentile: Top 94%
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.