Generative language models exhibit social identity biases

Social identity biases, particularly the tendency to favor one's own group (ingroup solidarity) and derogate other groups (outgroup hostility), are deeply rooted in human psychology and social behavior. However, it is unknown if such biases are also present in artificial intelligence systems. Here we show that large language models (LLMs) exhibit patterns of social identity bias, similarly to humans. By administering sentence completion prompts to 77 different LLMs (for instance, 'We are…'), we demonstrate that nearly all base models and some instruction-tuned and preference-tuned models display clear ingroup favoritism and outgroup derogation. These biases manifest both in controlled experimental settings and in naturalistic human-LLM conversations. However, we find that careful curation of training data and specialized fine-tuning can substantially reduce bias levels. These findings have important implications for developing more equitable artificial intelligence systems and highlight the urgent need to understand how human-LLM interactions might reinforce existing social biases.

Authors

Institutions

Publication Details

Journal
Nature Computational Science
Published
2024-12-12
DOI
https://doi.org/10.1038/s43588-024-00741-1
Citations
53
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
18.41

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generative language models exhibit social identity biases

Tiancheng Hu, Jon Roozenbeek, Steve Rathje, Nigel Collier et al.
53 citations
Nature Computational Science
Topic Modeling
18.41
article

Generative language models exhibit social identity biases

Tiancheng Hu, Jon Roozenbeek, Steve Rathje, Nigel Collier, Sander van der Linden, Yara Kyrychenko
article en
53 citations

Abstract

Social identity biases, particularly the tendency to favor one's own group (ingroup solidarity) and derogate other groups (outgroup hostility), are deeply rooted in human psychology and social behavior. However, it is unknown if such biases are also present in artificial intelligence systems. Here we show that large language models (LLMs) exhibit patterns of social identity bias, similarly to humans. By administering sentence completion prompts to 77 different LLMs (for instance, 'We are…'), we demonstrate that nearly all base models and some instruction-tuned and preference-tuned models display clear ingroup favoritism and outgroup derogation. These biases manifest both in controlled experimental settings and in naturalistic human-LLM conversations. However, we find that careful curation of training data and specialized fine-tuning can substantially reduce bias levels. These findings have important implications for developing more equitable artificial intelligence systems and highlight the urgent need to understand how human-LLM interactions might reinforce existing social biases.

Nature Computational ScienceVol. 5(1)
King's College London (GB), University of Cambridge (GB), New York University (US)
Bill and Melinda Gates Foundation, Dell EMC, Cambridge Trust, Gates Cambridge Trust, Engineering and Physical Sciences Research Council, Science and Technology Facilities Council
Reduced inequalities
Openalex Percentile: Top 1%
Topic Modeling
18.41
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.