Effective Content Moderation: A Framework for Toxic Comment Analysis Using Machine Learning

This work showcases toxic comment analysis using Natural Language Processing to estimate toxicity levels of usergenerated comments on a scale from 0 to 1. By quantifying toxicity, the work addresses maintaining positive interactions in online environments. The benchmark output is the toxicity score as a regression task, with binary classification labeling comments as toxic (score >0.5) or non-toxic (score ≤0.5) for additional insights. This research leverages the datasets with associated toxicity levels, making it suitable for supervised machine learning. In this work, we combine the strengths of TF-IDF and Bag of Words(BoW) in proposing optimized SGD Regressor and Decision Tree based model for toxic comment classificattion.The model achieved an accuracy of 96%, along with AUC of 92%. It outperformed previously implemented techniques and models. We can conclude that it emerges as a powerful technique to evaluate toxicity on social media, leveraging it in diverse linguistic and cultural contexts.

Authors

Institutions

Publication Details

Published
2025-03-28
DOI
https://doi.org/10.1109/ngise64126.2025.11085366
Citations
1
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Effective Content Moderation: A Framework for Toxic Comment Analysis Using Machine Learning

Nitin Arvind Shelke, Adarsh Singh Jadon, Ashish Joshi, Rohit Agrawal
1 citations
Hate Speech and Cyberbullying Detection
2.48
article

Effective Content Moderation: A Framework for Toxic Comment Analysis Using Machine Learning

Nitin Arvind Shelke, Adarsh Singh Jadon, Ashish Joshi, Rohit Agrawal
article en
1 citations

Abstract

This work showcases toxic comment analysis using Natural Language Processing to estimate toxicity levels of usergenerated comments on a scale from 0 to 1. By quantifying toxicity, the work addresses maintaining positive interactions in online environments. The benchmark output is the toxicity score as a regression task, with binary classification labeling comments as toxic (score >0.5) or non-toxic (score ≤0.5) for additional insights. This research leverages the datasets with associated toxicity levels, making it suitable for supervised machine learning. In this work, we combine the strengths of TF-IDF and Bag of Words(BoW) in proposing optimized SGD Regressor and Decision Tree based model for toxic comment classificattion.The model achieved an accuracy of 96%, along with AUC of 92%. It outperformed previously implemented techniques and models. We can conclude that it emerges as a powerful technique to evaluate toxicity on social media, leveraging it in diverse linguistic and cultural contexts.

Bennett University (IN)
Openalex Percentile: Top 9%
Hate Speech and Cyberbullying Detection
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.