Perceptions of AI as a Misinformation Moderator: The Roles of Argument Type and Group Chat Size

Content moderators aim to prevent misinformation and abuse in online communities. Human moderators have limitations like limited capacity that can potentially be addressed by AI moderators. However, in order for AI to be effective as a moderator, we need to understand how people perceive an AI moderator compared to a human moderator. We report two experiments (N = 698) that showed a human or AI moderating misinformation in online groups, varying the moderator's arguments and the group's size. In Experiment~1, AI was seen as less effective when it used harm-based arguments to refute misinformation; however, this gap disappeared a year later in Experiment~2, perhaps as attitudes towards AI shifted. Perceptions of AI moderator effectiveness were unaffected by the moderated group's size. We suggest that there may be growing acceptance of AI as content moderators in online groups, and highlight some of the potential challenges their use may raise.

Authors

Institutions

Publication Details

Published
2025-09-28
DOI
https://doi.org/10.31234/osf.io/r9aew_v1
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Perceptions of AI as a Misinformation Moderator: The Roles of Argument Type and Group Chat Size

Benjamin Silver, Sterling Williams‐Ceci, Mor Naaman
Misinformation and Its Impacts
article

Perceptions of AI as a Misinformation Moderator: The Roles of Argument Type and Group Chat Size

Benjamin Silver, Sterling Williams‐Ceci, Mor Naaman
article en

Abstract

Content moderators aim to prevent misinformation and abuse in online communities. Human moderators have limitations like limited capacity that can potentially be addressed by AI moderators. However, in order for AI to be effective as a moderator, we need to understand how people perceive an AI moderator compared to a human moderator. We report two experiments (N = 698) that showed a human or AI moderating misinformation in online groups, varying the moderator's arguments and the group's size. In Experiment~1, AI was seen as less effective when it used harm-based arguments to refute misinformation; however, this gap disappeared a year later in Experiment~2, perhaps as attitudes towards AI shifted. Perceptions of AI moderator effectiveness were unaffected by the moderated group's size. We suggest that there may be growing acceptance of AI as content moderators in online groups, and highlight some of the potential challenges their use may raise.

Cornell University (US)
Openalex Percentile: Top 65%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.