Zero-Shot Multi-Modal Learning for Cross-Lingual Visual Hate Speech Detection

This paper attempts to deal with the practical challenge associated with hate speech detection in multiple languages and content formats across online environments. The approach is a novel zero-shot, multimodal, cross-lingual framework with the aid of pretrained models such as CLIP for visual feature extraction and XLM-RoBERTa for multilingual text processing. These two pretrained models help eliminate dependency on labeled datasets and make it robust in complex multimodal scenarios. Evaluations on the MMHS150K show high accuracy and generalization capabilities, which underline its practical applicability in fostering safer digital spaces and lay a foundation for future multimodal cross-lingual applications.

Authors

Institutions

Publication Details

Published
2024-12-11
DOI
https://doi.org/10.1109/icscna63714.2024.10864120
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Zero-Shot Multi-Modal Learning for Cross-Lingual Visual Hate Speech Detection

Shoichiro Suda, Siddique Ibrahim S P, P. Sandeep, Waseem Baig et al.
Hate Speech and Cyberbullying Detection
article

Zero-Shot Multi-Modal Learning for Cross-Lingual Visual Hate Speech Detection

Shoichiro Suda, Siddique Ibrahim S P, P. Sandeep, Waseem Baig, Naga Bhavani Prasad Konda, Kaushik Makineni
article en

Abstract

This paper attempts to deal with the practical challenge associated with hate speech detection in multiple languages and content formats across online environments. The approach is a novel zero-shot, multimodal, cross-lingual framework with the aid of pretrained models such as CLIP for visual feature extraction and XLM-RoBERTa for multilingual text processing. These two pretrained models help eliminate dependency on labeled datasets and make it robust in complex multimodal scenarios. Evaluations on the MMHS150K show high accuracy and generalization capabilities, which underline its practical applicability in fostering safer digital spaces and lay a foundation for future multimodal cross-lingual applications.

SRM University (IN), VIT-AP University
Reduced inequalities
Openalex Percentile: Top 75%
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Zero-Shot Multi-Modal Learning for Cross-Lingual Visual Hate Speech Detection — Shoichiro Suda, Siddique Ibrahim S P, et al. · (2024) | TGRS Research Map | TGRS