Evaluation of Chat Generative Pre-trained Transformer and Microsoft Copilot Performance on the American Society of Surgery of the Hand Self-Assessment Examinations

While holding promise within medical education, caution should be used with large language models as more detailed evaluation of consistency is needed. Future studies should explore how these models perform across multiple trials and contexts to truly assess their reliability.

Authors

Institutions

Publication Details

Journal
Journal of Hand Surgery Global Online
Published
2024-11-13
DOI
https://doi.org/10.1016/j.jhsg.2024.10.001
Citations
5
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.60
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluation of Chat Generative Pre-trained Transformer and Microsoft Copilot Performance on the American Society of Surgery of the Hand Self-Assessment Examinations

António Costa, Claudio Moriconi, Nicolas Lee, Jeffrey Kwong et al.
5 citations
Journal of Hand Surgery Global Online
Artificial Intelligence in Healthcare and Education
0.60
article

Evaluation of Chat Generative Pre-trained Transformer and Microsoft Copilot Performance on the American Society of Surgery of the Hand Self-Assessment Examinations

António Costa, Claudio Moriconi, Nicolas Lee, Jeffrey Kwong, Gurnoor S Gill, Taylor Rakauskas
article en
5 citations

Abstract

While holding promise within medical education, caution should be used with large language models as more detailed evaluation of consistency is needed. Future studies should explore how these models perform across multiple trials and contexts to truly assess their reliability.

Journal of Hand Surgery Global OnlineVol. 7(1)
University of California, San Francisco (US), Florida Atlantic University (US)
Openalex Percentile: Top 28%
Artificial Intelligence in Healthcare and Education
0.60
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.