From area under the curve to clinical readiness: A framework for AI ‐assisted ectasia risk assessment before refractive surgery
Artificial intelligence (AI) models for keratoconus frequently report near-perfect discrimination, with pooled sensitivity and specificity approaching 98% when manifest keratoconus is separated from normal corneas. These figures are increasingly invoked to answer a different, more consequential question: whether an apparently non-ectatic cornea can safely undergo refractive surgery. We argue this is a task mismatch rather than a performance shortfall. Three targets are routinely conflated-manifest keratoconus, subclinical phenotype and future post-refractive ectasia-with the evidence strongest for the target furthest from the clinical question and weakest for the one closest. Underlying this is a single methodological issue: the absence of a robust reference standard, or ground truth, appropriate to the surgical decision. These estimates also derive largely from enriched case-control datasets, with subclinical-keratoconus case proportions of roughly 25% against an estimated 1% clinical prevalence. Applied to 1000 candidates at 1% prevalence, the pooled estimates correspond to approximately one missed subclinical case (0.6-1.6) and 45 false-positive referrals (25-80), both ranges derived from the reported confidence bounds-modelled diagnostic outcomes, not postoperative ectasia risk. We propose that ectasia-risk AI be evaluated as decision support for surgical eligibility, along a decision-anchored evidence chain spanning clinical validity, calibration and threshold-specific error, transportability, decision utility and post-deployment surveillance-complementing, rather than replacing, TRIPOD+AI, PROBAST+AI, STARD-AI, DECIDE-AI and FUTURE-AI. For refractive surgery, trust should not be inferred from a high area under the curve; it should be earned through evidence that follows the decision from target definition to real-world surveillance.
Authors
- Andrzej E. Grzybowski (ORCID: https://orcid.org/0000-0002-3724-2391)
- İbrahim Toprak (ORCID: https://orcid.org/0000-0001-6325-7485)
- Kai Jin (ORCID: https://orcid.org/0000-0003-4369-2417)
Institutions
- Second Affiliated Hospital of Zhejiang University (CN)
- Foundation for the Development of Ophthalmology (PL)
- University of Warmia and Mazury in Olsztyn (PL)
- Pamukkale University (TR)
- Zhejiang University (CN)
Publication Details
- Journal
- Acta Ophthalmologica
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1111/aos.70278
- Primary Topic
- Corneal surgery and disorders
- Type
- article
- Field-Weighted Citation Impact
- 0.00