Demographic Background Prompting Does Not Affect Linguistic Features on LLM-Generated News Texts

We explored if implicit demographic information in prompts for large language models (LLMs) influences the linguistic features of generated text. Two LLMs were prompted to write news articles based on a title and summary, with prompts including demographic details like age, income, or nationality. The models were instructed not to explicitly reference these details. A total of 28,080 articles were generated by varying the demographics and topics. We calculated various linguistic metrics (e.g., sentence length, type-token ratio) and performed ANOVA, treating linguistic metrics as dependent variables and demographic categories as independent variables. Results indicate that demographic attributes do not significantly impact the linguistic metrics.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.17979/spudc.9788497498913.24
Primary Topic
Authorship Attribution and Profiling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Demographic Background Prompting Does Not Affect Linguistic Features on LLM-Generated News Texts

Alberto Muñoz-Ortiz, Carlos Gómez‐Rodríguez, David Vilares
Authorship Attribution and Profiling
article

Demographic Background Prompting Does Not Affect Linguistic Features on LLM-Generated News Texts

Alberto Muñoz-Ortiz, Carlos Gómez‐Rodríguez, David Vilares
article en

Abstract

We explored if implicit demographic information in prompts for large language models (LLMs) influences the linguistic features of generated text. Two LLMs were prompted to write news articles based on a title and summary, with prompts including demographic details like age, income, or nationality. The models were instructed not to explicitly reference these details. A total of 28,080 articles were generated by varying the demographics and topics. We calculated various linguistic metrics (e.g., sentence length, type-token ratio) and performed ANOVA, treating linguistic metrics as dependent variables and demographic categories as independent variables. Results indicate that demographic attributes do not significantly impact the linguistic metrics.

CITIC Group (China) (CN)
Xunta de Galicia, European Regional Development Fund, Agencia Estatal de Investigación, European Social Fund
Openalex Percentile: Top 75%
Authorship Attribution and Profiling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.