Management of Dupuytren’s Disease: A Multi-Centric Comparative Analysis Between Experienced Hand Surgeons Versus Artificial Intelligence

<b>Background</b>: Dupuytren's fibroproliferative disease affecting the hand's palmar fascia leads to progressive finger contractures and functional limitations. Management of this condition relies heavily on the expertise of hand surgeons, who tailor interventions based on clinical assessment. With the growing interest in artificial intelligence (AI) in medical decision-making, this study aims to evaluate the feasibility of integrating AI into the clinical management of Dupuytren's disease by comparing AI-generated recommendations with those of expert hand surgeons. <b>Methods</b>: This multicentric comparative study involved three experienced hand surgeons and five AI systems (ChatGPT, Gemini, Perplexity, DeepSeek, and Copilot). Twenty-two standardized clinical prompts representing various Dupuytren's disease scenarios were used to assess decision-making. Surgeons and AI systems provided management recommendations, which were analyzed for concordance, rationale, and predicted outcomes. Key metrics included union accuracy, surgeon agreement, precision, recall, and F1 scores. The study also evaluated AI performance in unanimous versus non-unanimous cases and inter-AI agreements. <b>Results</b>: Gemini and ChatGPT demonstrated the highest union accuracy (86.4% and 81.8%, respectively), while Copilot showed the lowest (40.9%). Surgeon agreement was highest for Gemini (45.5%) and ChatGPT (42.4%). AI systems performed better in unanimous cases (accuracy up to 92.0%) than in non-unanimous cases (accuracy as low as 35.0%). Inter-AI agreements ranged from 75.0% (ChatGPT-Gemini) to 48.0% (DeepSeek-Copilot). Precision, recall, and F1 scores were consistently higher for ChatGPT and Gemini than for other systems. <b>Conclusions</b>: AI systems, particularly Gemini and ChatGPT, show promise in aligning with expert surgical recommendations, especially in straightforward cases. However, significant variability exists, particularly in complex scenarios. AI should be viewed as complementary to clinical judgment, requiring further refinement and validation for integration into clinical practice.

Authors

Institutions

Publication Details

Journal
Diagnostics
Published
2025-02-28
DOI
https://doi.org/10.3390/diagnostics15050587
Citations
18
Primary Topic
Dupuytren's Contracture and Treatments
Type
article
Field-Weighted Citation Impact
30.03
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Management of Dupuytren’s Disease: A Multi-Centric Comparative Analysis Between Experienced Hand Surgeons Versus Artificial Intelligence

Warren M. Rozen, Sally Ng, Kaiyang Lim, Ishith Seth et al.
18 citations
Diagnostics
Dupuytren's Contracture and Treatments
30.03
article

Management of Dupuytren’s Disease: A Multi-Centric Comparative Analysis Between Experienced Hand Surgeons Versus Artificial Intelligence

Warren M. Rozen, Sally Ng, Kaiyang Lim, Ishith Seth, Gianluca Marcaccini, M Castrechini, Roberto Cuomo, Richard J. Ross
article en
18 citations

Abstract

<b>Background</b>: Dupuytren's fibroproliferative disease affecting the hand's palmar fascia leads to progressive finger contractures and functional limitations. Management of this condition relies heavily on the expertise of hand surgeons, who tailor interventions based on clinical assessment. With the growing interest in artificial intelligence (AI) in medical decision-making, this study aims to evaluate the feasibility of integrating AI into the clinical management of Dupuytren's disease by comparing AI-generated recommendations with those of expert hand surgeons. <b>Methods</b>: This multicentric comparative study involved three experienced hand surgeons and five AI systems (ChatGPT, Gemini, Perplexity, DeepSeek, and Copilot). Twenty-two standardized clinical prompts representing various Dupuytren's disease scenarios were used to assess decision-making. Surgeons and AI systems provided management recommendations, which were analyzed for concordance, rationale, and predicted outcomes. Key metrics included union accuracy, surgeon agreement, precision, recall, and F1 scores. The study also evaluated AI performance in unanimous versus non-unanimous cases and inter-AI agreements. <b>Results</b>: Gemini and ChatGPT demonstrated the highest union accuracy (86.4% and 81.8%, respectively), while Copilot showed the lowest (40.9%). Surgeon agreement was highest for Gemini (45.5%) and ChatGPT (42.4%). AI systems performed better in unanimous cases (accuracy up to 92.0%) than in non-unanimous cases (accuracy as low as 35.0%). Inter-AI agreements ranged from 75.0% (ChatGPT-Gemini) to 48.0% (DeepSeek-Copilot). Precision, recall, and F1 scores were consistently higher for ChatGPT and Gemini than for other systems. <b>Conclusions</b>: AI systems, particularly Gemini and ChatGPT, show promise in aligning with expert surgical recommendations, especially in straightforward cases. However, significant variability exists, particularly in complex scenarios. AI should be viewed as complementary to clinical judgment, requiring further refinement and validation for integration into clinical practice.

DiagnosticsVol. 15(5)
University of Siena (IT), Peninsula Health (AU), Austin Health (AU), Monash University (AU), Sapienza University of Rome (IT)
Openalex Percentile: Top 0%
Dupuytren's Contracture and Treatments
30.03
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.