Full end-to-end diagnostic workflow automation of 3D OCT via foundation model-driven AI for retinal diseases
Optical coherence tomography (OCT) has revolutionized retinal disease diagnosis with its high-resolution and three-dimensional imaging nature, yet its full diagnostic automation in clinical practices remains constrained by multi-stage workflows and conventional single-slice, single-task AI models. We present Full-process OCT-based Clinical Utility System (FOCUS), a foundation model-driven framework enabling end-to-end automation of 3D OCT retinal disease diagnosis. FOCUS sequentially performs image quality assessment with EfficientNetV2-S, followed by abnormality detection and multi-disease classification using a fine-tuned Vision Foundation Model. Crucially, FOCUS leverages a unified adaptive aggregation method to intelligently integrate 2D slice-level predictions into comprehensive 3D patient-level diagnosis. Trained and tested on 3300 patients (40,672 slices), and externally validated on 1345 patients (18,498 slices) across four different-tier centers and diverse OCT devices, FOCUS achieved high F1-scores for quality assessment (99.01%), abnormally detection (97.46%), and patient-level diagnosis (94.39%). Real-world validation across centers also showed stable performance (F1: 90.22–95.24%). In human-machine comparisons, FOCUS matched expert performance in abnormality detection (F1: 95.47% vs 90.91%) and multi-disease diagnosis (F1: 93.49% vs 91.35%), while demonstrating better efficiency. FOCUS automates the image-to-diagnosis pipeline, representing a critical advance towards unmanned ophthalmology with a validated blueprint for autonomous screening to enhance population scale retinal care accessibility and efficiency.
Authors
- N. Li
- Honghui Xia
- Jian Zhong
- Jinze Zhang (ORCID: https://orcid.org/0000-0002-4461-1095)
- Juping Liu (ORCID: https://orcid.org/0000-0001-9720-8227)
- Zhengyu Duan
- Peng Xiao
- Mengyun Zhou
- Jin Yuan
- Yuan Pan
- Zeyu Meng
- Meng Li
- Li Lin
- Sutong Li
- Shang Huang
- Dan Liang
- Xiaoying Tang
- Yantao Wei
- Shilong Yu
- Jiaxiong Li
- Ke Ma
Institutions
- Beijing Tongren Hospital (CN)
- Hong Kong Polytechnic University (HK)
- Sun Yat-sen University (CN)
- Guangdong Medical College (CN)
- Capital Medical University (CN)
- Southern University of Science and Technology (CN)
- Jiaxing University (CN)
- Zhongshan People's Hospital (CN)
- Tianjin Medical University Eye Hospital (CN)
- Third Affiliated Hospital of Sun Yat-sen University (CN)
- The First People's Hospital of Zhaoqing (CN)
- Tianjin Medical University (CN)
- University of Hong Kong (HK)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-08-19
- DOI
- https://doi.org/10.1038/s41746-026-03151-x
- Primary Topic
- Retinal Imaging and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Sun Yat-sen University
- Guangdong Science and Technology Department
- State Key Laboratory of Ophthalmology
- National Key Research and Development Program of China
- Fundamental Research Funds for the Central Universities