Research and Analysis of Trust and Control in Human-AI Interaction for Decision-Making Systems in Optimizing Public Health Service
This research investigates the interplay between trust and control in the context of AI-enabled healthcare decision-making using a cybernetic approach to how clinicians adjust their trust toward AI-powered clinical decision support systems. It seeks to uncover the barriers to AI implementation within clinical practices regarding dependency and trust towards AI technologies. Forty-two clinicians who used an AI-powered clinical decision support system in radiology participated in an empirical mixed-method study. Participants interpreted x-ray images with different levels of AI control and transparency. Trust ratings, override behaviors, and decision accuracy were captured and analyzed with t-tests, ANOVA, and regression models. Trust dynamics were explored through semi-structured interviews. The findings reveal that when the AI adheres to clinical reasoning, its transparency boosts trust, yet it diminishes confidence when an error occurs.
Authors
- Xiaoxuan Yu
- Qian Zhao (ORCID: https://orcid.org/0000-0002-8716-8193)
- Hongming Li (ORCID: https://orcid.org/0000-0002-6024-677X)
- Yixin Chen (ORCID: https://orcid.org/0000-0002-3704-4432)
Institutions
- University of Florida (US)
- China Medical University (CN)
- Northeastern University (CN)
Publication Details
- Journal
- Journal of Organizational and End User Computing
- Published
- 2025-09-15
- DOI
- https://doi.org/10.4018/joeuc.388626
- Primary Topic
- Impact of AI and Big Data on Business and Society
- Type
- article
- Field-Weighted Citation Impact
- 0.00