Assessing the accuracy and quality of artificial intelligence (AI) chatbot-generated responses in making patient-specific drug-therapy and healthcare-related decisions

ChatGPT is not ready to take on the coaching role for either healthcare learners or healthcare professionals. The lack of consistency in the responses to the same question is problematic for both learners and decision-makers. The intrinsic assumptions made by the chatbot could lead to erroneous clinical decisions. The unreliability in providing valid references is a serious flaw in using ChatGPT to drive clinical decision making.

Authors

Institutions

Publication Details

Journal
BMC Medical Informatics and Decision Making
Published
2024-12-24
DOI
https://doi.org/10.1186/s12911-024-02824-5
Citations
41
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
4.93
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Assessing the accuracy and quality of artificial intelligence (AI) chatbot-generated responses in making patient-specific drug-therapy and healthcare-related decisions

Abigail Winter, Taixiong Zheng, Lingtak‐Neander Chan, Leigh Ann Mike et al.
41 citations
BMC Medical Informatics and Decision Making
Artificial Intelligence in Healthcare and Education
4.93
article

Assessing the accuracy and quality of artificial intelligence (AI) chatbot-generated responses in making patient-specific drug-therapy and healthcare-related decisions

Abigail Winter, Taixiong Zheng, Lingtak‐Neander Chan, Leigh Ann Mike, Mekonnen Sisay Shiferaw
article en
41 citations

Abstract

ChatGPT is not ready to take on the coaching role for either healthcare learners or healthcare professionals. The lack of consistency in the responses to the same question is problematic for both learners and decision-makers. The intrinsic assumptions made by the chatbot could lead to erroneous clinical decisions. The unreliability in providing valid references is a serious flaw in using ChatGPT to drive clinical decision making.

BMC Medical Informatics and Decision MakingVol. 24(1)
Seattle Pacific University (US), University of Washington (US)
Peace, Justice and strong institutions
Openalex Percentile: Top 4%
Artificial Intelligence in Healthcare and Education
4.93
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.