Can Community Notes Replace Professional Fact-Checkers?

Two commonly employed strategies to combat the rise of misinformation on social media are (i) fact-checking by professional organisations and (ii) community moderation by platform users.Policy changes by Twitter/X and, more recently, Meta, signal a shift away from partnerships with fact-checking organisations and towards an increased reliance on crowdsourced community notes.However, the extent and nature of dependencies between fact-checking and helpful community notes remain unclear.To address these questions, we use language models to annotate a large corpus of Twitter/X community notes with attributes such as topic, cited sources, and whether they refute claims tied to broader misinformation narratives.Our analysis reveals that community notes cite factchecking sources up to five times more than previously reported.Fact-checking is especially crucial for notes on posts linked to broader narratives, which are twice as likely to reference fact-checking sources compared to other sources.Our results show that successful community moderation relies on professional factchecking and highlight how citizen and professional fact-checking are deeply intertwined.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-short.42
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can Community Notes Replace Professional Fact-Checkers?

Nadav Borenstein, Desmond Elliott, Isabelle Augenstein, George W. Warren
Topic Modeling
article

Can Community Notes Replace Professional Fact-Checkers?

Nadav Borenstein, Desmond Elliott, Isabelle Augenstein, George W. Warren
article en

Abstract

Two commonly employed strategies to combat the rise of misinformation on social media are (i) fact-checking by professional organisations and (ii) community moderation by platform users.Policy changes by Twitter/X and, more recently, Meta, signal a shift away from partnerships with fact-checking organisations and towards an increased reliance on crowdsourced community notes.However, the extent and nature of dependencies between fact-checking and helpful community notes remain unclear.To address these questions, we use language models to annotate a large corpus of Twitter/X community notes with attributes such as topic, cited sources, and whether they refute claims tied to broader misinformation narratives.Our analysis reveals that community notes cite factchecking sources up to five times more than previously reported.Fact-checking is especially crucial for notes on posts linked to broader narratives, which are twice as likely to reference fact-checking sources compared to other sources.Our results show that successful community moderation relies on professional factchecking and highlight how citizen and professional fact-checking are deeply intertwined.

University of Copenhagen (DK)
European Commission, Danmarks Grundforskningsfond
Openalex Percentile: Top 90%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.