A comparative analysis of generative artificial intelligence responses from leading chatbots to questions about endometriosis

The analysis of LLMs revealed that, on average, they mainly provided correct but inadequate responses to commonly asked patient questions about endometriosis. While chatbot responses can serve as valuable supplements to information provided by licensed medical professionals, it is crucial to maintain a thorough ongoing evaluation process for outputs to provide the most comprehensive and accurate information to patients. Further research into this technology and its role in patient education and treatment is crucial as generative AI becomes more embedded in the medical field.

Authors

Institutions

Publication Details

Journal
AJOG Global Reports
Published
2024-10-05
DOI
https://doi.org/10.1016/j.xagr.2024.100405
Citations
8
Primary Topic
Uterine Myomas and Treatments
Type
article
Field-Weighted Citation Impact
4.66
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A comparative analysis of generative artificial intelligence responses from leading chatbots to questions about endometriosis

Milan Ho, Donald McIntire, Kimberly A. Kho, Katherine Smith et al.
8 citations
AJOG Global Reports
Uterine Myomas and Treatments
4.66
article

A comparative analysis of generative artificial intelligence responses from leading chatbots to questions about endometriosis

Milan Ho, Donald McIntire, Kimberly A. Kho, Katherine Smith, Natalie D Cohen
article en
8 citations

Abstract

The analysis of LLMs revealed that, on average, they mainly provided correct but inadequate responses to commonly asked patient questions about endometriosis. While chatbot responses can serve as valuable supplements to information provided by licensed medical professionals, it is crucial to maintain a thorough ongoing evaluation process for outputs to provide the most comprehensive and accurate information to patients. Further research into this technology and its role in patient education and treatment is crucial as generative AI becomes more embedded in the medical field.

AJOG Global ReportsVol. 5(1)
The University of Texas Southwestern Medical Center (US)
Openalex Percentile: Top 5%
Uterine Myomas and Treatments
4.66
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.