Rethinking news framing with large language models

Mainstream media, with its broad reach, plays a central role in shaping public opinion and thus warrants close scrutiny. Subtle forms of media bias-such as selective fact presentation and tone-can meaningfully influence public attitudes, even when reporting remains factually accurate. Although effects such as these have been widely studied by scholars of framing, much of the existing research focuses on specific topics and relies on manually constructed or pre-existing frames, limiting both scalability and generalizability. Here we introduce a novel framework that leverages large language models (LLMs) to generate synthetic news articles by systematically varying the selection and tone of the content while holding factual accuracy and other features constant. We evaluate the impact of these alternative framings in a large, pre-registered randomized experiment (N = 2,141), and find that selective presentation of accurate information can significantly shift individuals' policy views and emotional responses across a diverse collection of topics. These effects are consistently stronger for negative than positive framings and are more pronounced among individuals who say they are less informed about the topic. Our findings demonstrate the persuasive power of subtle bias in mainstream news as well as the value of LLMs as tools for scalable, controlled investigations of media effects.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-11-28
DOI
https://doi.org/10.1038/s41598-025-29519-9
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Rethinking news framing with large language models

Duncan J. Watts, Amir Tohidi, Samar Haider
Scientific Reports
Computational and Text Analysis Methods
article

Rethinking news framing with large language models

Duncan J. Watts, Amir Tohidi, Samar Haider
article en

Abstract

Mainstream media, with its broad reach, plays a central role in shaping public opinion and thus warrants close scrutiny. Subtle forms of media bias-such as selective fact presentation and tone-can meaningfully influence public attitudes, even when reporting remains factually accurate. Although effects such as these have been widely studied by scholars of framing, much of the existing research focuses on specific topics and relies on manually constructed or pre-existing frames, limiting both scalability and generalizability. Here we introduce a novel framework that leverages large language models (LLMs) to generate synthetic news articles by systematically varying the selection and tone of the content while holding factual accuracy and other features constant. We evaluate the impact of these alternative framings in a large, pre-registered randomized experiment (N = 2,141), and find that selective presentation of accurate information can significantly shift individuals' policy views and emotional responses across a diverse collection of topics. These effects are consistently stronger for negative than positive framings and are more pronounced among individuals who say they are less informed about the topic. Our findings demonstrate the persuasive power of subtle bias in mainstream news as well as the value of LLMs as tools for scalable, controlled investigations of media effects.

Scientific ReportsVol. 15(1)
University of Pennsylvania (US)
U.S. Department of Defense, John S. and James L. Knight Foundation, Defense Advanced Research Projects Agency, Advanced Research Projects Agency
Openalex Percentile: Top 53%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Rethinking news framing with large language models — Duncan J. Watts, Amir Tohidi, et al. · Scientific Reports (2025) | TGRS Research Map | TGRS