Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context

Gender-inclusive language is often used with the aim of ensuring that all individuals, regardless of gender, can be associated with certain concepts.While psycholinguistic studies have examined its effects in relation to human cognition, it remains unclear how Large Language Models (LLMs) process gender-inclusive language.Given that commercial LLMs are gaining an increasingly strong foothold in everyday applications, it is crucial to examine whether LLMs in fact interpret gender-inclusive language neutrally, because the language they generate has the potential to influence the language of their users.This study examines whether LLM-generated coreferent terms align with a given gender expression or reflect model biases.Adapting psycholinguistic methods from French to English and German, we find that in English, LLMs generally maintain the antecedent's gender but exhibit underlying masculine bias.In German, this bias is much stronger, overriding all tested genderneutralization strategies.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.gebnlp-1.38
Primary Topic
Gender Studies in Language
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context

Susan Leavy, Marion Bartl, Thomas Brendan Murphy
Gender Studies in Language
article

Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context

Susan Leavy, Marion Bartl, Thomas Brendan Murphy
article en

Abstract

Gender-inclusive language is often used with the aim of ensuring that all individuals, regardless of gender, can be associated with certain concepts.While psycholinguistic studies have examined its effects in relation to human cognition, it remains unclear how Large Language Models (LLMs) process gender-inclusive language.Given that commercial LLMs are gaining an increasingly strong foothold in everyday applications, it is crucial to examine whether LLMs in fact interpret gender-inclusive language neutrally, because the language they generate has the potential to influence the language of their users.This study examines whether LLM-generated coreferent terms align with a given gender expression or reflect model biases.Adapting psycholinguistic methods from French to English and German, we find that in English, LLMs generally maintain the antecedent's gender but exhibit underlying masculine bias.In German, this bias is much stronger, overriding all tested genderneutralization strategies.

Quality Education
Openalex Percentile: Top 76%
Gender Studies in Language
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.