The Impact of Persona-based Political Perspectives on Hateful Content Detection

While pretraining language models with politically diverse content has been shown to improve downstream task fairness, such approaches require significant computational resources often inaccessible to many researchers and organizations.Recent work has established that persona-based prompting can introduce political diversity in model outputs without additional training.However, it remains unclear whether such prompting strategies can achieve results comparable to political pretraining for downstream tasks.We investigate this question using persona-based prompting strategies in multimodal hate-speech detection tasks, specifically focusing on hate speech in memes.Our analysis reveals that when mapping personas onto a political compass and measuring persona agreement, inherent political positioning has surprisingly little correlation with classification decisions.Notably, this lack of correlation persists even when personas are explicitly injected with stronger ideological descriptors.Our findings suggest that while LLMs can exhibit political biases in their responses to direct political questions, these biases may have less impact on practical classification tasks than previously assumed.This raises important questions about the necessity of computationally expensive political pretraining for achieving fair performance in downstream tasks.

Authors

Institutions

Publication Details

Published
2025-05-08
DOI
https://doi.org/10.1145/3701716.3718383
Citations
1
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Impact of Persona-based Political Perspectives on Hateful Content Detection

Gianluca Demartini, Pietro Bernardelle, Stefano Civelli
1 citations
Hate Speech and Cyberbullying Detection
2.48
article

The Impact of Persona-based Political Perspectives on Hateful Content Detection

Gianluca Demartini, Pietro Bernardelle, Stefano Civelli
article en
1 citations

Abstract

While pretraining language models with politically diverse content has been shown to improve downstream task fairness, such approaches require significant computational resources often inaccessible to many researchers and organizations.Recent work has established that persona-based prompting can introduce political diversity in model outputs without additional training.However, it remains unclear whether such prompting strategies can achieve results comparable to political pretraining for downstream tasks.We investigate this question using persona-based prompting strategies in multimodal hate-speech detection tasks, specifically focusing on hate speech in memes.Our analysis reveals that when mapping personas onto a political compass and measuring persona agreement, inherent political positioning has surprisingly little correlation with classification decisions.Notably, this lack of correlation persists even when personas are explicitly injected with stronger ideological descriptors.Our findings suggest that while LLMs can exhibit political biases in their responses to direct political questions, these biases may have less impact on practical classification tasks than previously assumed.This raises important questions about the necessity of computationally expensive political pretraining for achieving fair performance in downstream tasks.

The University of Queensland (AU)
National Science Foundation, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
Gender equality
Openalex Percentile: Top 10%
Hate Speech and Cyberbullying Detection
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.