People who share encounters with racism are silenced online by humans and machines, but a guideline-reframing intervention holds promise
Are members of marginalized communities silenced on social media when they share personal experiences of racism? Here, we investigate the role of algorithms, humans, and platform guidelines in suppressing disclosures of racial discrimination. In a field study of actual posts from a neighborhood-based social media platform, we find that when users talk about their experiences as targets of racism, their posts are disproportionately flagged for removal as toxic by five widely used moderation algorithms from major online platforms, including the most recent large language models. We show that human users disproportionately flag these disclosures for removal as well. Next, in a follow-up experiment, we demonstrate that merely witnessing such suppression negatively influences how Black Americans view the community and their place in it. Finally, to address these challenges to equity and inclusion in online spaces, we introduce a mitigation strategy: a guideline-reframing intervention that is effective at reducing silencing behavior across the political spectrum.
Authors
- Esin Durmus (ORCID: https://orcid.org/0009-0009-7331-8160)
- Xuan Zhao (ORCID: https://orcid.org/0000-0002-0893-8920)
- MarYam G Hamedani (ORCID: https://orcid.org/0000-0001-6925-4947)
- Pratyusha Kalluri (ORCID: https://orcid.org/0000-0001-7202-8027)
- Nay San (ORCID: https://orcid.org/0000-0002-3533-5025)
- Hazel Rose Markus
- Kiara L. Sanchez (ORCID: https://orcid.org/0000-0001-8924-6661)
- Kristina Gligorić (ORCID: https://orcid.org/0000-0001-8726-740X)
- Cinoo Lee (ORCID: https://orcid.org/0009-0002-1305-4705)
- Jennifer L. Eberhardt (ORCID: https://orcid.org/0000-0003-1687-8128)
- Maggie Harrington
- Dan Jurafsky (ORCID: https://orcid.org/0000-0002-6459-7745)
- Danny Tse
Institutions
- Dartmouth College (US)
- Stanford University (US)
Publication Details
- Journal
- Proceedings of the National Academy of Sciences
- Published
- 2024-09-09
- DOI
- https://doi.org/10.1073/pnas.2322764121
- Citations
- 13
- Primary Topic
- Hate Speech and Cyberbullying Detection
- Type
- article
- Field-Weighted Citation Impact
- 4.52
Funders
- National Science Foundation
- Sage Foundation