Explainable Ai for Offensive Content Detection and Analysis on Social Media
The widespread use of online platforms has led to an increase in inappropriate content, posing significant challenges to digital safety. This paper presents the development of a chatbot designed for offensive content analysis in online conversations. Utilizing advanced machine learning techniques, the chatbot employs a Support Vector Classifier (SVC) combined with Word2Vec for detecting offensive language. Additionally, a LIME model is introduced to enhance interpretability by analyzing the contribution of different words toward the offensiveness score. As a second phase, from the detected offensive content a Logistic Regression-based multi-label model is used to assess toxicity levels. Trained on a dataset of Twitter messages labeled for offensive and non-offensive content, the system effectively identifies and classifies harmful language. With high accuracy and computational efficiency, this solution enhances content moderation efforts and promotes a safer online environment.
Authors
- Anne M. Joseph (ORCID: https://orcid.org/0000-0002-3440-2679)
- Geevarghese Titus (ORCID: https://orcid.org/0000-0002-2666-8047)
- Fabeela Ali Rawther
- Абдусаламов М.-П.Б.
- A K Abhinay
- Adham Saheer
Institutions
- Government Medical College (IN)
Publication Details
- Published
- 2025-07-18
- DOI
- https://doi.org/10.1109/accthpa65749.2025.11168549
- Primary Topic
- Hate Speech and Cyberbullying Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00