Effective Content Moderation: A Framework for Toxic Comment Analysis Using Machine Learning
This work showcases toxic comment analysis using Natural Language Processing to estimate toxicity levels of usergenerated comments on a scale from 0 to 1. By quantifying toxicity, the work addresses maintaining positive interactions in online environments. The benchmark output is the toxicity score as a regression task, with binary classification labeling comments as toxic (score >0.5) or non-toxic (score ≤0.5) for additional insights. This research leverages the datasets with associated toxicity levels, making it suitable for supervised machine learning. In this work, we combine the strengths of TF-IDF and Bag of Words(BoW) in proposing optimized SGD Regressor and Decision Tree based model for toxic comment classificattion.The model achieved an accuracy of 96%, along with AUC of 92%. It outperformed previously implemented techniques and models. We can conclude that it emerges as a powerful technique to evaluate toxicity on social media, leveraging it in diverse linguistic and cultural contexts.
Authors
- Nitin Arvind Shelke (ORCID: https://orcid.org/0000-0002-4801-1345)
- Adarsh Singh Jadon
- Ashish Joshi (ORCID: https://orcid.org/0000-0002-0302-2569)
- Rohit Agrawal (ORCID: https://orcid.org/0000-0001-7731-2078)
Institutions
- Bennett University (IN)
Publication Details
- Published
- 2025-03-28
- DOI
- https://doi.org/10.1109/ngise64126.2025.11085366
- Citations
- 1
- Primary Topic
- Hate Speech and Cyberbullying Detection
- Type
- article
- Field-Weighted Citation Impact
- 2.48