People who share encounters with racism are silenced online by humans and machines, but a guideline-reframing intervention holds promise

Are members of marginalized communities silenced on social media when they share personal experiences of racism? Here, we investigate the role of algorithms, humans, and platform guidelines in suppressing disclosures of racial discrimination. In a field study of actual posts from a neighborhood-based social media platform, we find that when users talk about their experiences as targets of racism, their posts are disproportionately flagged for removal as toxic by five widely used moderation algorithms from major online platforms, including the most recent large language models. We show that human users disproportionately flag these disclosures for removal as well. Next, in a follow-up experiment, we demonstrate that merely witnessing such suppression negatively influences how Black Americans view the community and their place in it. Finally, to address these challenges to equity and inclusion in online spaces, we introduce a mitigation strategy: a guideline-reframing intervention that is effective at reducing silencing behavior across the political spectrum.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2024-09-09
DOI
https://doi.org/10.1073/pnas.2322764121
Citations
13
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
4.52

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

People who share encounters with racism are silenced online by humans and machines, but a guideline-reframing intervention holds promise

Esin Durmus, Xuan Zhao, MarYam G Hamedani, Pratyusha Kalluri et al.
13 citations
Proceedings of the National Academy of Sciences
Hate Speech and Cyberbullying Detection
4.52
article

People who share encounters with racism are silenced online by humans and machines, but a guideline-reframing intervention holds promise

Esin Durmus, Xuan Zhao, MarYam G Hamedani, Pratyusha Kalluri, Nay San, Hazel Rose Markus, Kiara L. Sanchez, Kristina Gligorić, Cinoo Lee, Jennifer L. Eberhardt, Maggie Harrington, Dan Jurafsky, Danny Tse
article en
13 citations

Abstract

Are members of marginalized communities silenced on social media when they share personal experiences of racism? Here, we investigate the role of algorithms, humans, and platform guidelines in suppressing disclosures of racial discrimination. In a field study of actual posts from a neighborhood-based social media platform, we find that when users talk about their experiences as targets of racism, their posts are disproportionately flagged for removal as toxic by five widely used moderation algorithms from major online platforms, including the most recent large language models. We show that human users disproportionately flag these disclosures for removal as well. Next, in a follow-up experiment, we demonstrate that merely witnessing such suppression negatively influences how Black Americans view the community and their place in it. Finally, to address these challenges to equity and inclusion in online spaces, we introduce a mitigation strategy: a guideline-reframing intervention that is effective at reducing silencing behavior across the political spectrum.

Proceedings of the National Academy of SciencesVol. 121(38)
Dartmouth College (US), Stanford University (US)
National Science Foundation, Sage Foundation
Reduced inequalities
Openalex Percentile: Top 5%
Hate Speech and Cyberbullying Detection
4.52
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.