Improving debriefing practices for participants in social science experiments

Social science experiments often expose participants to false, deceptive, or otherwise harmful content. In an effort to mitigate the effects of such content and to comply with regulatory standards, these studies usually conclude by "debriefing" participants about the content they encountered, on the assumption that doing so will eliminate the effects of exposure. We present evidence showing that this assumption is not always correct. After standard debriefs, participants who have seen political misinformation often remain worse-informed than if they had never been exposed to misinformation in the first place. We then design and test a new approach to debriefing, which entails (i) debriefing as soon after exposure to harmful content as possible; (ii) providing an informative correction; and (iii) requiring participants to affirm that they have been exposed to false information. Across multiple experiments, we show that this approach is far superior to standard debriefs at reducing the effects of false or harmful content on political attitudes and beliefs. Our approach makes it possible to study the effects of false or harmful content on attitudes and beliefs without posing significant risks to participants.

Authors

Institutions

Publication Details

Journal
PNAS Nexus
Published
2024-11-28
DOI
https://doi.org/10.1093/pnasnexus/pgae502
Citations
1
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
1.13

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving debriefing practices for participants in social science experiments

Yamil Velez, Ethan Porter, Katherine Clayton, Thomas Wood
1 citations
PNAS Nexus
Misinformation and Its Impacts
1.13
article

Improving debriefing practices for participants in social science experiments

Yamil Velez, Ethan Porter, Katherine Clayton, Thomas Wood
article en
1 citations

Abstract

Social science experiments often expose participants to false, deceptive, or otherwise harmful content. In an effort to mitigate the effects of such content and to comply with regulatory standards, these studies usually conclude by "debriefing" participants about the content they encountered, on the assumption that doing so will eliminate the effects of exposure. We present evidence showing that this assumption is not always correct. After standard debriefs, participants who have seen political misinformation often remain worse-informed than if they had never been exposed to misinformation in the first place. We then design and test a new approach to debriefing, which entails (i) debriefing as soon after exposure to harmful content as possible; (ii) providing an informative correction; and (iii) requiring participants to affirm that they have been exposed to false information. Across multiple experiments, we show that this approach is far superior to standard debriefs at reducing the effects of false or harmful content on political attitudes and beliefs. Our approach makes it possible to study the effects of false or harmful content on attitudes and beliefs without posing significant risks to participants.

PNAS NexusVol. 3(12)
George Washington University (US), The Ohio State University (US), Columbia University (US), Stanford University (US)
John S. and James L. Knight Foundation, George Washington University
Peace, Justice and strong institutions
Openalex Percentile: Top 14%
Misinformation and Its Impacts
1.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Improving debriefing practices for participants in social science experiments — Yamil Velez, Ethan Porter, et al. · PNAS Nexus (2024) | TGRS Research Map | TGRS