Fake or fact? Evaluating chatbots’ performance to help users detect fake news in human-computer communities

The rapid proliferation of fake news poses a significant challenge to information ecosystems, particularly in digital and social media environments. This study investigates the effectiveness of chatbot interventions in assisting users with fake news detection within human-computer communities. Grounded in the Heuristic-Systematic Model, the study employs a 6 (fake news type) × 3 (chatbot intervention strategy) mixed design to examine how different chatbot strategies - fact-checking, contextual explanations, and authority endorsements - affect users’ ability to identify various types of fake news. The results show that fact-checking is most effective for detecting fabrication and photo manipulation, contextual explanations enhance recognition of satire and parody-based fake news, and authority endorsements are particularly useful in countering propaganda. These findings highlight the importance of tailoring chatbot interventions to specific fake news types.

Authors

Institutions

Publication Details

Journal
Journalism
Published
2025-11-06
DOI
https://doi.org/10.1177/14648849251395797
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fake or fact? Evaluating chatbots’ performance to help users detect fake news in human-computer communities

Zehang Xie, Yunxiang Xie, Hui Hui
Journalism
Misinformation and Its Impacts
article

Fake or fact? Evaluating chatbots’ performance to help users detect fake news in human-computer communities

Zehang Xie, Yunxiang Xie, Hui Hui
article en

Abstract

The rapid proliferation of fake news poses a significant challenge to information ecosystems, particularly in digital and social media environments. This study investigates the effectiveness of chatbot interventions in assisting users with fake news detection within human-computer communities. Grounded in the Heuristic-Systematic Model, the study employs a 6 (fake news type) × 3 (chatbot intervention strategy) mixed design to examine how different chatbot strategies - fact-checking, contextual explanations, and authority endorsements - affect users’ ability to identify various types of fake news. The results show that fact-checking is most effective for detecting fabrication and photo manipulation, contextual explanations enhance recognition of satire and parody-based fake news, and authority endorsements are particularly useful in countering propaganda. These findings highlight the importance of tailoring chatbot interventions to specific fake news types.

Journalism
Nanyang Technological University (SG), Shanghai Jiao Tong University (CN)
Openalex Percentile: Top 57%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.