Fake or fact? Evaluating chatbots’ performance to help users detect fake news in human-computer communities
The rapid proliferation of fake news poses a significant challenge to information ecosystems, particularly in digital and social media environments. This study investigates the effectiveness of chatbot interventions in assisting users with fake news detection within human-computer communities. Grounded in the Heuristic-Systematic Model, the study employs a 6 (fake news type) × 3 (chatbot intervention strategy) mixed design to examine how different chatbot strategies - fact-checking, contextual explanations, and authority endorsements - affect users’ ability to identify various types of fake news. The results show that fact-checking is most effective for detecting fabrication and photo manipulation, contextual explanations enhance recognition of satire and parody-based fake news, and authority endorsements are particularly useful in countering propaganda. These findings highlight the importance of tailoring chatbot interventions to specific fake news types.
Authors
- Zehang Xie (ORCID: https://orcid.org/0000-0003-2665-2640)
- Yunxiang Xie (ORCID: https://orcid.org/0009-0006-5268-3693)
- Hui Hui (ORCID: https://orcid.org/0009-0008-6874-0220)
Institutions
- Nanyang Technological University (SG)
- Shanghai Jiao Tong University (CN)
Publication Details
- Journal
- Journalism
- Published
- 2025-11-06
- DOI
- https://doi.org/10.1177/14648849251395797
- Primary Topic
- Misinformation and Its Impacts
- Type
- article
- Field-Weighted Citation Impact
- 0.00