Fundus Image Enhancement Through Direct Diffusion Bridges
We propose FD3, a fundus image enhancement method based on direct diffusion bridges, which can cope with a wide range of complex degradations, including haze, blur, noise, and shadow. We first propose a synthetic forward model through a human feedback loop with board-certified ophthalmologists for maximal quality improvement of low-quality in-vivo images. Using the proposed forward model, we train a robust and flexible diffusion-based image enhancement network that is highly effective as a stand-alone method, unlike previous diffusion model-based approaches which act only as a refiner on top of pre-trained models. Through extensive experiments, we show that FD3 establishes superior quality not only on synthetic degradations but also on in vivo studies with low-quality fundus photos taken from patients with cataracts or small pupils.
Authors
- Hyungjin Chung (ORCID: https://orcid.org/0000-0003-3202-0893)
- Jong Chul Ye (ORCID: https://orcid.org/0000-0001-9763-9609)
- Se Hie Park
- Sehui Kim (ORCID: https://orcid.org/0000-0002-6640-3051)
- Kayoung Yi (ORCID: https://orcid.org/0000-0002-6512-5782)
- Eui-Sang Chung
Institutions
- Korea Advanced Institute of Science and Technology (KR)
- Hallym University Kangnam Sacred Heart Hospital (KR)
- Korea Institute of Brain Science (KR)
- Onnuri Smile Eye Clinic (KR)
Publication Details
- Journal
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2024-08-21
- DOI
- https://doi.org/10.1109/jbhi.2024.3446866
- Citations
- 7
- Primary Topic
- Retinal Imaging and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 2.83
Funders
- Korea Medical Device Development Fund
- Ministry of Trade, Industry and Energy
- Ministry of Food and Drug Safety
- National Research Foundation of Korea
- Ministry of Science and ICT, South Korea