Source transparency and accuracy warnings support more selective reliance on generative-AI answers in a randomized online experiment

Generative-AI systems increasingly provide answers to everyday questions, but users need to decide not only whether to accept an answer, but whether acceptance should depend on answer correctness. This randomized online experiment tested whether visible source information and an accuracy warning supported more selective reliance on AI-style answers. A final analytic sample of 800 adult participants was assigned to one of four between-subjects cue conditions in a 2 × 2 × 2 mixed design crossing source transparency (absent vs. present), accuracy warning (absent vs. present), and answer correctness (incorrect vs. correct, within participant). Each participant evaluated 24 AI-style answers, yielding 19,200 trial-level observations. The primary analysis used all trials and modelled acceptance as a function of source transparency, accuracy warning, answer correctness, and their interactions. Participants accepted correct answers more often than incorrect answers, and the correct-incorrect acceptance gap was largest in the source-plus-warning condition. In the applied-risk model restricted to incorrect-answer trials, acceptance of incorrect answers was highest in the control condition (1080/2400, 45%) and lower in the source-only (864/2400, 36%), warning-only (672/2400, 28%), and source-plus-warning conditions (504/2400, 21%). Verification behaviour was highest in the combined condition (2496/4800, 52%). These results indicate that brief on-screen cues lowered erroneous-answer acceptance and encouraged verification in low-risk information-evaluation tasks, while the distinction between response bias and sensitivity remains an important boundary condition.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-11-14
DOI
https://doi.org/10.1038/s41598-026-80733-5
Primary Topic
Information Retrieval and Search Behavior
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Source transparency and accuracy warnings support more selective reliance on generative-AI answers in a randomized online experiment

Yike Zhang, Xiaomei Lu, Zeyu Zhang, Yanhua Xing et al.
3 links
Scientific Reports
Information Retrieval and Search Behavior
article

Source transparency and accuracy warnings support more selective reliance on generative-AI answers in a randomized online experiment

Yike Zhang, Xiaomei Lu, Zeyu Zhang, Yanhua Xing, Min Zhang
article en

Abstract

Generative-AI systems increasingly provide answers to everyday questions, but users need to decide not only whether to accept an answer, but whether acceptance should depend on answer correctness. This randomized online experiment tested whether visible source information and an accuracy warning supported more selective reliance on AI-style answers. A final analytic sample of 800 adult participants was assigned to one of four between-subjects cue conditions in a 2 × 2 × 2 mixed design crossing source transparency (absent vs. present), accuracy warning (absent vs. present), and answer correctness (incorrect vs. correct, within participant). Each participant evaluated 24 AI-style answers, yielding 19,200 trial-level observations. The primary analysis used all trials and modelled acceptance as a function of source transparency, accuracy warning, answer correctness, and their interactions. Participants accepted correct answers more often than incorrect answers, and the correct-incorrect acceptance gap was largest in the source-plus-warning condition. In the applied-risk model restricted to incorrect-answer trials, acceptance of incorrect answers was highest in the control condition (1080/2400, 45%) and lower in the source-only (864/2400, 36%), warning-only (672/2400, 28%), and source-plus-warning conditions (504/2400, 21%). Verification behaviour was highest in the combined condition (2496/4800, 52%). These results indicate that brief on-screen cues lowered erroneous-answer acceptance and encouraged verification in low-risk information-evaluation tasks, while the distinction between response bias and sensitivity remains an important boundary condition.

Scientific Reports
Xinjiang Normal University (CN), Nanjing University of Finance and Economics (CN), Xi’an University of Posts and Telecommunications (CN), Xinjiang University of Political Science and Law (CN), Xi'an Jiaotong University (CN)
Information Retrieval and Search Behavior
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon