Bias in the Mirror : Are LLMs opinions robust to their own adversarial attacks

Large language models (LLMs) inherit biases from their training data and alignment processes, influencing their responses in subtle ways.While many studies have examined these biases, little work has explored their robustness during interactions.In this paper, we introduce a novel approach where two instances of an LLM engage in self-debate, arguing opposing viewpoints to persuade a neutral version of the model.Through this, we evaluate how firmly biases hold and whether models are susceptible to reinforcing misinformation or shifting to harmful viewpoints.Our experiments span multiple LLMs of varying sizes, origins, and languages, providing deeper insights into bias persistence and flexibility across linguistic and cultural contexts.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-long.106
Citations
1
Primary Topic
Law, AI, and Intellectual Property
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bias in the Mirror : Are LLMs opinions robust to their own adversarial attacks

Christos Xypolopoulos, Virgile Rennard, Michalis Vazirgiannis
1 citations
Law, AI, and Intellectual Property
2.48
article

Bias in the Mirror : Are LLMs opinions robust to their own adversarial attacks

Christos Xypolopoulos, Virgile Rennard, Michalis Vazirgiannis
article en
1 citations

Abstract

Large language models (LLMs) inherit biases from their training data and alignment processes, influencing their responses in subtle ways.While many studies have examined these biases, little work has explored their robustness during interactions.In this paper, we introduce a novel approach where two instances of an LLM engage in self-debate, arguing opposing viewpoints to persuade a neutral version of the model.Through this, we evaluate how firmly biases hold and whether models are susceptible to reinforcing misinformation or shifting to harmful viewpoints.Our experiments span multiple LLMs of varying sizes, origins, and languages, providing deeper insights into bias persistence and flexibility across linguistic and cultural contexts.

Agence Nationale de la Recherche
Openalex Percentile: Top 9%
Law, AI, and Intellectual Property
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.