Comparative Efficacy of ChatGPT and Gemini in Addressing Patient Queries on Gonarthrosis and Total Knee Arthroplasty: A Randomized Controlled Trial

The emergence of artificial intelligence (AI) in health care has created novel opportunities for enhancing patient education and alleviating anxiety. This study seeks to evaluate the effectiveness of two leading AI platforms, ChatGPT and Gemini, in delivering accurate and satisfactory responses to patients with gonarthrosis, considering total knee arthroplasty (TKA). A prospective, randomized controlled trial was conducted involving 100 patients diagnosed with gonarthrosis and indicated for TKA. Each patient posed five questions regarding the surgery and postoperative rehabilitation to both ChatGPT and Gemini. Responses were evaluated by two blinded orthopaedic specialists on a 10-point scale for accuracy and patient satisfaction. Patients additionally evaluated their satisfaction with each response using a 10-point scale. The main outcome measures consisted of the average accuracy scores assessed by specialists and the average satisfaction scores reported by patients. Statistical analysis revealed significant differences between ChatGPT and Gemini in both accuracy and patient satisfaction (<i>p</i> < 0.001). ChatGPT demonstrated better performance with a mean accuracy score of 8.7 ± 0.9 compared with Gemini's 7.2 ± 1.1. Patient satisfaction scores aligned with expert evaluations, with ChatGPT achieving a mean satisfaction score of 8.9 ± 0.8 versus Gemini's 7.5 ± 1.2. Notably, ChatGPT excelled in providing comprehensive explanations of surgical procedures (mean score: 9.2 ± 0.7) and postoperative care (9.1 ± 0.8), whereas Gemini performed better in offering concise summaries of recovery timelines (8.4 ± 0.9). This study demonstrates that ChatGPT offers more accurate and satisfactory responses to patient queries regarding gonarthrosis and TKA compared with Gemini. The findings suggest that AI platforms, particularly ChatGPT, can serve as valuable tools in augmenting patient education and potentially reducing preoperative anxiety. Future studies should investigate the incorporation of AI-assisted information delivery into clinical practice and its long-term effects on patient outcomes.

Authors

Institutions

Publication Details

Journal
The Journal of Knee Surgery
Published
2025-09-19
DOI
https://doi.org/10.1055/a-2693-0756
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Efficacy of ChatGPT and Gemini in Addressing Patient Queries on Gonarthrosis and Total Knee Arthroplasty: A Randomized Controlled Trial

Yunus İmren, Niyazi İğde, Serhat Gürbüz, Bulent Karslıoğlu et al.
The Journal of Knee Surgery
Artificial Intelligence in Healthcare and Education
article

Comparative Efficacy of ChatGPT and Gemini in Addressing Patient Queries on Gonarthrosis and Total Knee Arthroplasty: A Randomized Controlled Trial

Yunus İmren, Niyazi İğde, Serhat Gürbüz, Bulent Karslıoğlu, Ahmet Keskin, Mustafa Bugra Ayaz
article en

Abstract

The emergence of artificial intelligence (AI) in health care has created novel opportunities for enhancing patient education and alleviating anxiety. This study seeks to evaluate the effectiveness of two leading AI platforms, ChatGPT and Gemini, in delivering accurate and satisfactory responses to patients with gonarthrosis, considering total knee arthroplasty (TKA). A prospective, randomized controlled trial was conducted involving 100 patients diagnosed with gonarthrosis and indicated for TKA. Each patient posed five questions regarding the surgery and postoperative rehabilitation to both ChatGPT and Gemini. Responses were evaluated by two blinded orthopaedic specialists on a 10-point scale for accuracy and patient satisfaction. Patients additionally evaluated their satisfaction with each response using a 10-point scale. The main outcome measures consisted of the average accuracy scores assessed by specialists and the average satisfaction scores reported by patients. Statistical analysis revealed significant differences between ChatGPT and Gemini in both accuracy and patient satisfaction (<i>p</i> < 0.001). ChatGPT demonstrated better performance with a mean accuracy score of 8.7 ± 0.9 compared with Gemini's 7.2 ± 1.1. Patient satisfaction scores aligned with expert evaluations, with ChatGPT achieving a mean satisfaction score of 8.9 ± 0.8 versus Gemini's 7.5 ± 1.2. Notably, ChatGPT excelled in providing comprehensive explanations of surgical procedures (mean score: 9.2 ± 0.7) and postoperative care (9.1 ± 0.8), whereas Gemini performed better in offering concise summaries of recovery timelines (8.4 ± 0.9). This study demonstrates that ChatGPT offers more accurate and satisfactory responses to patient queries regarding gonarthrosis and TKA compared with Gemini. The findings suggest that AI platforms, particularly ChatGPT, can serve as valuable tools in augmenting patient education and potentially reducing preoperative anxiety. Future studies should investigate the incorporation of AI-assisted information delivery into clinical practice and its long-term effects on patient outcomes.

The Journal of Knee SurgeryVol. 39(03)
Sabancı Üniversitesi (TR), Sağlık Bilimleri Üniversitesi (TR), Liv Hospital (TR)
Openalex Percentile: Top 81%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.