Zero-Shot Multi-Modal Learning for Cross-Lingual Visual Hate Speech Detection
This paper attempts to deal with the practical challenge associated with hate speech detection in multiple languages and content formats across online environments. The approach is a novel zero-shot, multimodal, cross-lingual framework with the aid of pretrained models such as CLIP for visual feature extraction and XLM-RoBERTa for multilingual text processing. These two pretrained models help eliminate dependency on labeled datasets and make it robust in complex multimodal scenarios. Evaluations on the MMHS150K show high accuracy and generalization capabilities, which underline its practical applicability in fostering safer digital spaces and lay a foundation for future multimodal cross-lingual applications.
Authors
- Shoichiro Suda (ORCID: https://orcid.org/0000-0003-2790-5101)
- Siddique Ibrahim S P (ORCID: https://orcid.org/0000-0003-3310-6090)
- P. Sandeep
- Waseem Baig
- Naga Bhavani Prasad Konda
- Kaushik Makineni
Institutions
- SRM University (IN)
- VIT-AP University
Publication Details
- Published
- 2024-12-11
- DOI
- https://doi.org/10.1109/icscna63714.2024.10864120
- Primary Topic
- Hate Speech and Cyberbullying Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00