Harnessing Generative Pre-trained Transformer Technology for Clinical Decision Support in Retinal Detachment

Abs tractAim: Considering the increasing incorporation of artificial intelligence (AI) in healthcare, it is crucial to comprehend the advantages and constraints of these technologies within ophthalmologic settings for their secure and efficient clinical utilization.This study aims to comprehensively assess the efficacy of three leading Generative Pre-trained Transformer (GPT) -based platforms in providing clinical decision-support for retinal detachment (RD). Methods:This cross-sectional comparative study was conducted between April 2024 and May 2024.Fifty questions were created based on the American Academy of Ophthalmology "Retina Book", specifically targeting RD.The answers were produced by three different platforms and assessed by three independent reviewers who used Likert scales to evaluate their comprehensiveness and accuracy.Six readability metrics, including the Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease Score (FRES), average words per sentence, average syllables per word, total sentence count, and total word count, were assessed.Results: Gemini earned the most outstanding results for comprehensiveness (4.110.72)and accuracy (1.490.61),followed by ChatGPT and Copilot.ChatGPT had superior readability metrics, achieving an FKGL of 15.622.85 and a FRES of 62.5412.34,establishing it as the most accessible platform.ChatGPT demonstrated significantly higher performance compared to other platforms in the metrics of average syllables per word (p=0.0421) and total word count (p=0.0115).At the same time, no significant differences were found among the platforms in the metrics of average words per sentence (p=0.0842) and total sentence count (p=0.1603).Intraclass correlation coefficient (ICC) values indicated strong inter-rater agreement for comprehensiveness (ICC >0.74) and moderateto-high agreement for accuracy (ICC >0.56). Conclusion:Gemini's detailed and accurate responses position it as a robust tool for professional use, while ChatGPT's superior readability makes it suitable for patient education.These findings emphasize the synergistic advantages of AI platforms in research and development management and show the necessity for hybrid systems that integrate accessibility with accuracy.

Authors

Publication Details

Journal
Medical Bulletin of Haseki
Published
2025-08-12
DOI
https://doi.org/10.4274/haseki.galenos.2025.79553
Primary Topic
Retinal and Macular Surgery
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Harnessing Generative Pre-trained Transformer Technology for Clinical Decision Support in Retinal Detachment

Yücel Öztürk, Abdullah Ağın, Ulviye Kivrak
Medical Bulletin of Haseki
Retinal and Macular Surgery
article

Harnessing Generative Pre-trained Transformer Technology for Clinical Decision Support in Retinal Detachment

Yücel Öztürk, Abdullah Ağın, Ulviye Kivrak
article en

Abstract

Abs tractAim: Considering the increasing incorporation of artificial intelligence (AI) in healthcare, it is crucial to comprehend the advantages and constraints of these technologies within ophthalmologic settings for their secure and efficient clinical utilization.This study aims to comprehensively assess the efficacy of three leading Generative Pre-trained Transformer (GPT) -based platforms in providing clinical decision-support for retinal detachment (RD). Methods:This cross-sectional comparative study was conducted between April 2024 and May 2024.Fifty questions were created based on the American Academy of Ophthalmology "Retina Book", specifically targeting RD.The answers were produced by three different platforms and assessed by three independent reviewers who used Likert scales to evaluate their comprehensiveness and accuracy.Six readability metrics, including the Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease Score (FRES), average words per sentence, average syllables per word, total sentence count, and total word count, were assessed.Results: Gemini earned the most outstanding results for comprehensiveness (4.110.72)and accuracy (1.490.61),followed by ChatGPT and Copilot.ChatGPT had superior readability metrics, achieving an FKGL of 15.622.85 and a FRES of 62.5412.34,establishing it as the most accessible platform.ChatGPT demonstrated significantly higher performance compared to other platforms in the metrics of average syllables per word (p=0.0421) and total word count (p=0.0115).At the same time, no significant differences were found among the platforms in the metrics of average words per sentence (p=0.0842) and total sentence count (p=0.1603).Intraclass correlation coefficient (ICC) values indicated strong inter-rater agreement for comprehensiveness (ICC >0.74) and moderateto-high agreement for accuracy (ICC >0.56). Conclusion:Gemini's detailed and accurate responses position it as a robust tool for professional use, while ChatGPT's superior readability makes it suitable for patient education.These findings emphasize the synergistic advantages of AI platforms in research and development management and show the necessity for hybrid systems that integrate accessibility with accuracy.

Medical Bulletin of Haseki
Peace, Justice and strong institutions
Openalex Percentile: Top 70%
Retinal and Macular Surgery
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.