Usability and adoption in a randomized trial of GutGPT a GenAI tool for gastrointestinal bleeding
Generative AI (GenAI) may enhance clinical decision support systems (CDSS), but its impact on adoption remains unclear. We conducted a simulation-based randomized trial to evaluate whether a GenAI-enhanced CDSS, "GutGPT," improves adoption compared to an AI dashboard in acute upper gastrointestinal bleeding management. Clinical trainees were randomized to either GutGPT or a comparator dashboard across three cases. The primary outcome was Behavioral Intention, from the Unified Theory of Acceptance and Use of Technology (UTAUT). Secondary measures included additional constructs and decision accuracy. A total of 106 participants participated (52 GutGPT, 54 comparator). GutGPT users reported higher Effort Expectancy. Behavioral Intention had no significant difference. Qualitative analysis highlighted trust and workflow concerns. These findings suggest that usability alone is insufficient to drive adoption. As this study was conducted in a simulation without real-world integration or patient outcomes, further studies are needed. (Trial Registration: ClinicalTrials.gov; Identifier: NCT05816473; Registered March 6, 2023).
Authors
- Niroop Rajashekar (ORCID: https://orcid.org/0000-0003-1205-6979)
- Loren Laine (ORCID: https://orcid.org/0000-0002-4296-7901)
- Kisung You (ORCID: https://orcid.org/0000-0002-8584-459X)
- Ambrose H. Wong (ORCID: https://orcid.org/0000-0001-7471-1647)
- Simone Kresevic (ORCID: https://orcid.org/0009-0008-1700-7512)
- Colleen Chan (ORCID: https://orcid.org/0000-0001-6323-5673)
- Jasjeet S. Sekhon (ORCID: https://orcid.org/0009-0003-1218-0117)
- Leigh V. Evans (ORCID: https://orcid.org/0000-0002-9667-4071)
- Sunny Chung (ORCID: https://orcid.org/0009-0005-5962-8913)
- Shinpei Nakamura-Sakai (ORCID: https://orcid.org/0000-0001-6413-5412)
- Allen Hsiao (ORCID: https://orcid.org/0000-0002-8080-0002)
- Theo Saarinen (ORCID: https://orcid.org/0009-0008-2361-5557)
- Mauro Giuffrè (ORCID: https://orcid.org/0000-0002-9910-3514)
- René F. Kizilcec (ORCID: https://orcid.org/0000-0001-6283-5546)
- Dennis Shung (ORCID: https://orcid.org/0000-0001-8226-1842)
- Terika McCall
- Yeo Eun Shin (ORCID: https://orcid.org/0009-0009-2914-8328)
- Yuan Pu
Institutions
- Berkeley College (US)
- Baruch College (US)
- University of Trieste (IT)
- Cornell University (US)
- Yale University (US)
- Mayo Clinic in Arizona (US)
- University of California, Berkeley (US)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2025-08-18
- DOI
- https://doi.org/10.1038/s41746-025-01896-5
- Citations
- 2
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 1.31
Funders
- National Institute of Diabetes and Digestive and Kidney Diseases