The ghost in the machine speaks with an American accent: cultural value drift in early GPT-3 and the case for pluralist evaluation of generative AI

Early large language models (LLMs) were released with minimal alignment, offering a rare view of how generative systems reframe the ethical values embedded in human texts. We examine outputs from a 2021 version of OpenAI’s base GPT-3, prompting it to summarise culturally diverse source materials (laws, political speeches, and philosophical works) and interpreting results through a descriptive, moral value pluralist lens. Where possible, we contextualise outputs with cross-national datasets such as the World Values Survey. We document recurring value drift: Australia’s firearm policy is recast as a threat to liberty; de Beauvoir’s feminist critique becomes gender-essentialist dating advice; and Merkel’s humanitarian appeal is recast as immigration control. In contrast, multilateral documents (UN/UNESCO) exhibit greater value stability, suggesting consensus-crafted language can buffer against cultural mutation. We argue that these early behaviours (observed before extensive fine-tuning and safety layers) provide a baseline for understanding how training distributions shape normative framing. Our contribution is twofold: (1) empirical evidence that value drift can invert or overwrite encoded values along predictable cultural axes, and (2) a pluralist, descriptive evaluation method that surfaces whose values dominate and when. We conclude with implications for culturally inclusive evaluation and alignment in contemporary LLMs.

Authors

Institutions

Publication Details

Journal
AI and Ethics
Published
2026-03-23
DOI
https://doi.org/10.1007/s43681-026-01038-x
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The ghost in the machine speaks with an American accent: cultural value drift in early GPT-3 and the case for pluralist evaluation of generative AI

Julija Kalpokienė, Rebecca L. Johnson, Enrico Panai, Natalia Menéndez González et al.
AI and Ethics
Computational and Text Analysis Methods
article

The ghost in the machine speaks with an American accent: cultural value drift in early GPT-3 and the case for pluralist evaluation of generative AI

Julija Kalpokienė, Rebecca L. Johnson, Enrico Panai, Natalia Menéndez González, Leslye Denisse Dias Duran, Giada Pistilli, Donald Jay Bertulfo
article en

Abstract

Early large language models (LLMs) were released with minimal alignment, offering a rare view of how generative systems reframe the ethical values embedded in human texts. We examine outputs from a 2021 version of OpenAI’s base GPT-3, prompting it to summarise culturally diverse source materials (laws, political speeches, and philosophical works) and interpreting results through a descriptive, moral value pluralist lens. Where possible, we contextualise outputs with cross-national datasets such as the World Values Survey. We document recurring value drift: Australia’s firearm policy is recast as a threat to liberty; de Beauvoir’s feminist critique becomes gender-essentialist dating advice; and Merkel’s humanitarian appeal is recast as immigration control. In contrast, multilateral documents (UN/UNESCO) exhibit greater value stability, suggesting consensus-crafted language can buffer against cultural mutation. We argue that these early behaviours (observed before extensive fine-tuning and safety layers) provide a baseline for understanding how training distributions shape normative framing. Our contribution is twofold: (1) empirical evidence that value drift can invert or overwrite encoded values along predictable cultural axes, and (2) a pluralist, descriptive evaluation method that surfaces whose values dominate and when. We conclude with implications for culturally inclusive evaluation and alignment in contemporary LLMs.

AI and EthicsVol. 6(2)
Università Cattolica del Sacro Cuore (IT), The University of Sydney (AU), Vytautas Magnus University (LT), University of Oxford (GB), Wellcome Centre for Ethics and Humanities (GB), European University Institute (IT), Delft University of Technology (NL)
Gender equality
Openalex Percentile: Top 32%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.