Improving Accuracy in Predicting Comment Toxicity in Threads Applications: a Comparison of Bidirectional Encoder Representations From Transformers and Gated Recurrent Units

The present study will attempt the use of machine learning in the evaluation of toxicity within threaded comments. We have availed ourselves of two very strong algorithms, BERT and GRU; each is known to perform well in solving such complexity in regard to harmful comments. We have divided the results into two groups of ten outcome values each for the prediction of the level of toxicity. For an extended analysis, we ran 50 iterations for each group, summing up to a total of 100 iterations. In the analysis done through SPSS, we kept the 95% Confidence Interval CI, alpha level at <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{0. 0 5}$</tex>, and statistical power G*power at <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{8 0 \%}$</tex>. This is to ensure that all our predictions over the levels of toxicity within threaded comments will be as accurate and reliable as possible. Algorithms, which were used for content moderation, showed very impressive performance in predicting the levels of toxicity, standing at <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{9 3. 0 3 \%}$</tex> accuracy. While comparing BERT with GRU, the identification comes that BERT has outperformed GRU with an accuracy rate of 93.03% whereas GRU has shown an accuracy rate of 84.66 %, which clearly indicates that BERT is the superior classifier to improve content moderation in online discussions.

Authors

Institutions

Publication Details

Published
2024-11-20
DOI
https://doi.org/10.1109/icetas62372.2024.11119964
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Accuracy in Predicting Comment Toxicity in Threads Applications: a Comparison of Bidirectional Encoder Representations From Transformers and Gated Recurrent Units

Rushil Anirudh, Farkhanda Qamar, S. Radhika
Software Engineering Research
article

Improving Accuracy in Predicting Comment Toxicity in Threads Applications: a Comparison of Bidirectional Encoder Representations From Transformers and Gated Recurrent Units

Rushil Anirudh, Farkhanda Qamar, S. Radhika
article en

Abstract

The present study will attempt the use of machine learning in the evaluation of toxicity within threaded comments. We have availed ourselves of two very strong algorithms, BERT and GRU; each is known to perform well in solving such complexity in regard to harmful comments. We have divided the results into two groups of ten outcome values each for the prediction of the level of toxicity. For an extended analysis, we ran 50 iterations for each group, summing up to a total of 100 iterations. In the analysis done through SPSS, we kept the 95% Confidence Interval CI, alpha level at <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{0. 0 5}$</tex>, and statistical power G*power at <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{8 0 \%}$</tex>. This is to ensure that all our predictions over the levels of toxicity within threaded comments will be as accurate and reliable as possible. Algorithms, which were used for content moderation, showed very impressive performance in predicting the levels of toxicity, standing at <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{9 3. 0 3 \%}$</tex> accuracy. While comparing BERT with GRU, the identification comes that BERT has outperformed GRU with an accuracy rate of 93.03% whereas GRU has shown an accuracy rate of 84.66 %, which clearly indicates that BERT is the superior classifier to improve content moderation in online discussions.

Pir Mehr Ali Shah Arid Agriculture University (PK), Saveetha University (IN)
Openalex Percentile: Top 49%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.