Explainable Ai for Offensive Content Detection and Analysis on Social Media

The widespread use of online platforms has led to an increase in inappropriate content, posing significant challenges to digital safety. This paper presents the development of a chatbot designed for offensive content analysis in online conversations. Utilizing advanced machine learning techniques, the chatbot employs a Support Vector Classifier (SVC) combined with Word2Vec for detecting offensive language. Additionally, a LIME model is introduced to enhance interpretability by analyzing the contribution of different words toward the offensiveness score. As a second phase, from the detected offensive content a Logistic Regression-based multi-label model is used to assess toxicity levels. Trained on a dataset of Twitter messages labeled for offensive and non-offensive content, the system effectively identifies and classifies harmful language. With high accuracy and computational efficiency, this solution enhances content moderation efforts and promotes a safer online environment.

Authors

Institutions

Publication Details

Published
2025-07-18
DOI
https://doi.org/10.1109/accthpa65749.2025.11168549
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Explainable Ai for Offensive Content Detection and Analysis on Social Media

Anne M. Joseph, Geevarghese Titus, Fabeela Ali Rawther, Абдусаламов М.-П.Б. et al.
Hate Speech and Cyberbullying Detection
article

Explainable Ai for Offensive Content Detection and Analysis on Social Media

Anne M. Joseph, Geevarghese Titus, Fabeela Ali Rawther, Абдусаламов М.-П.Б., A K Abhinay, Adham Saheer
article en

Abstract

The widespread use of online platforms has led to an increase in inappropriate content, posing significant challenges to digital safety. This paper presents the development of a chatbot designed for offensive content analysis in online conversations. Utilizing advanced machine learning techniques, the chatbot employs a Support Vector Classifier (SVC) combined with Word2Vec for detecting offensive language. Additionally, a LIME model is introduced to enhance interpretability by analyzing the contribution of different words toward the offensiveness score. As a second phase, from the detected offensive content a Logistic Regression-based multi-label model is used to assess toxicity levels. Trained on a dataset of Twitter messages labeled for offensive and non-offensive content, the system effectively identifies and classifies harmful language. With high accuracy and computational efficiency, this solution enhances content moderation efforts and promotes a safer online environment.

Government Medical College (IN)
Openalex Percentile: Top 86%
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Explainable Ai for Offensive Content Detection and Analysis on Social Media — Anne M. Joseph, Geevarghese Titus, et al. · (2025) | TGRS Research Map | TGRS