From area under the curve to clinical readiness: A framework for AI ‐assisted ectasia risk assessment before refractive surgery

Artificial intelligence (AI) models for keratoconus frequently report near-perfect discrimination, with pooled sensitivity and specificity approaching 98% when manifest keratoconus is separated from normal corneas. These figures are increasingly invoked to answer a different, more consequential question: whether an apparently non-ectatic cornea can safely undergo refractive surgery. We argue this is a task mismatch rather than a performance shortfall. Three targets are routinely conflated-manifest keratoconus, subclinical phenotype and future post-refractive ectasia-with the evidence strongest for the target furthest from the clinical question and weakest for the one closest. Underlying this is a single methodological issue: the absence of a robust reference standard, or ground truth, appropriate to the surgical decision. These estimates also derive largely from enriched case-control datasets, with subclinical-keratoconus case proportions of roughly 25% against an estimated 1% clinical prevalence. Applied to 1000 candidates at 1% prevalence, the pooled estimates correspond to approximately one missed subclinical case (0.6-1.6) and 45 false-positive referrals (25-80), both ranges derived from the reported confidence bounds-modelled diagnostic outcomes, not postoperative ectasia risk. We propose that ectasia-risk AI be evaluated as decision support for surgical eligibility, along a decision-anchored evidence chain spanning clinical validity, calibration and threshold-specific error, transportability, decision utility and post-deployment surveillance-complementing, rather than replacing, TRIPOD+AI, PROBAST+AI, STARD-AI, DECIDE-AI and FUTURE-AI. For refractive surgery, trust should not be inferred from a high area under the curve; it should be earned through evidence that follows the decision from target definition to real-world surveillance.

Authors

Institutions

Publication Details

Journal
Acta Ophthalmologica
Published
2026-11-18
DOI
https://doi.org/10.1111/aos.70278
Primary Topic
Corneal surgery and disorders
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

From area under the curve to clinical readiness: A framework for AI ‐assisted ectasia risk assessment before refractive surgery

Andrzej E. Grzybowski, İbrahim Toprak, Kai Jin
1 links
Acta Ophthalmologica
Corneal surgery and disorders
article

From area under the curve to clinical readiness: A framework for AI ‐assisted ectasia risk assessment before refractive surgery

Andrzej E. Grzybowski, İbrahim Toprak, Kai Jin
article en

Abstract

Artificial intelligence (AI) models for keratoconus frequently report near-perfect discrimination, with pooled sensitivity and specificity approaching 98% when manifest keratoconus is separated from normal corneas. These figures are increasingly invoked to answer a different, more consequential question: whether an apparently non-ectatic cornea can safely undergo refractive surgery. We argue this is a task mismatch rather than a performance shortfall. Three targets are routinely conflated-manifest keratoconus, subclinical phenotype and future post-refractive ectasia-with the evidence strongest for the target furthest from the clinical question and weakest for the one closest. Underlying this is a single methodological issue: the absence of a robust reference standard, or ground truth, appropriate to the surgical decision. These estimates also derive largely from enriched case-control datasets, with subclinical-keratoconus case proportions of roughly 25% against an estimated 1% clinical prevalence. Applied to 1000 candidates at 1% prevalence, the pooled estimates correspond to approximately one missed subclinical case (0.6-1.6) and 45 false-positive referrals (25-80), both ranges derived from the reported confidence bounds-modelled diagnostic outcomes, not postoperative ectasia risk. We propose that ectasia-risk AI be evaluated as decision support for surgical eligibility, along a decision-anchored evidence chain spanning clinical validity, calibration and threshold-specific error, transportability, decision utility and post-deployment surveillance-complementing, rather than replacing, TRIPOD+AI, PROBAST+AI, STARD-AI, DECIDE-AI and FUTURE-AI. For refractive surgery, trust should not be inferred from a high area under the curve; it should be earned through evidence that follows the decision from target definition to real-world surveillance.

Acta Ophthalmologica
Second Affiliated Hospital of Zhejiang University (CN), Foundation for the Development of Ophthalmology (PL), University of Warmia and Mazury in Olsztyn (PL), Pamukkale University (TR), Zhejiang University (CN)
Good health and well-being
Corneal surgery and disorders
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon