Framing Retractions in Scientific Media:A Computational Approach to Understanding Scientific Discourse

Retractions in scientific publishing are a critical mechanism for self-correction, yet they remain stigmatized, often associated with misconduct rather than honest error. This study investigates how retractions are framed in the informal content of two leading scientific journals, Science and Nature, using computational methods to analyze mentions of retractions from 1967 to 2023. We compare two distinct approaches to text classification: a dictionary-based method and a large language model (LLM), GPT4o-mini, to identify frames of “misconduct” and “honest mistake” in 999 articles. While the dictionary approach offers transparency, it struggles with nuanced language and contextual references. In contrast, the LLM demonstrates superior accuracy (88% vs. 62%) and provides interpretable explanations for its classifications.<br/>Our findings reveal that retractions are predominantly framed as “misconduct”, with mentions of “honest mistakes” decreasing over time, despite ongoing efforts to foster this frame as a way to motivate open data practices and build trust in scientists and science as a self-correcting endeavor. This trend is further underscored by the fact that external contributions use the “honest mistake” frame significantly less often than editorial and journalistic texts. Additionally, the attribution of misconduct is more prevalent in the fields of medicine &amp; health and biology compared to chemistry and physics, reflecting disciplinary differences in how retractions are socially constructed.<br/>This study not only highlights the methodological advantages and limitations of LLM approaches in frame analysis but also introduces their novel application in the social study of sciences, a field where such methods remain underutilized. By leveraging digital tools to analyze scientific discourse, we contribute to a deeper understanding of how retractions are socially constructed and propose pathways for destigmatizing this essential scientific practice.<br/>

Publication Details

Journal
VU Research Portal
Published
2025-05-08
Primary Topic
Magnetic confinement fusion research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Framing Retractions in Scientific Media:A Computational Approach to Understanding Scientific Discourse

VU Research Portal
Magnetic confinement fusion research
article

Framing Retractions in Scientific Media:A Computational Approach to Understanding Scientific Discourse

article en

Abstract

Retractions in scientific publishing are a critical mechanism for self-correction, yet they remain stigmatized, often associated with misconduct rather than honest error. This study investigates how retractions are framed in the informal content of two leading scientific journals, Science and Nature, using computational methods to analyze mentions of retractions from 1967 to 2023. We compare two distinct approaches to text classification: a dictionary-based method and a large language model (LLM), GPT4o-mini, to identify frames of “misconduct” and “honest mistake” in 999 articles. While the dictionary approach offers transparency, it struggles with nuanced language and contextual references. In contrast, the LLM demonstrates superior accuracy (88% vs. 62%) and provides interpretable explanations for its classifications.<br/>Our findings reveal that retractions are predominantly framed as “misconduct”, with mentions of “honest mistakes” decreasing over time, despite ongoing efforts to foster this frame as a way to motivate open data practices and build trust in scientists and science as a self-correcting endeavor. This trend is further underscored by the fact that external contributions use the “honest mistake” frame significantly less often than editorial and journalistic texts. Additionally, the attribution of misconduct is more prevalent in the fields of medicine &amp; health and biology compared to chemistry and physics, reflecting disciplinary differences in how retractions are socially constructed.<br/>This study not only highlights the methodological advantages and limitations of LLM approaches in frame analysis but also introduces their novel application in the social study of sciences, a field where such methods remain underutilized. By leveraging digital tools to analyze scientific discourse, we contribute to a deeper understanding of how retractions are socially constructed and propose pathways for destigmatizing this essential scientific practice.<br/>

VU Research Portal
Quality Education
Openalex Percentile: Top 52%
Magnetic confinement fusion research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.