Single-shot optically sectioned fluorescence endomicroscopy using unsupervised RCAN-CycleGAN

Optical sectioning endomicroscopy significantly improves image contrast by rejecting out-of-focus background fluorescence, but conventional HiLo microscopy requires at least two structured-illumination exposures and, in some cases, axial scanning, which increases acquisition time and system complexity. Obtaining large, perfectly registered wide-field and HiLo image pairs for supervised deep learning is also extremely challenging in vivo. Here, we present an unsupervised RCAN-CycleGAN framework that translates single-shot wide-field fluorescence endomicroscopy images into high-contrast, optically sectioned HiLo images using only unpaired training data. Trained on unpaired wide-field and HiLo images from fluorescent beads, ex vivo mouse brain, and plant specimens, the model generates HiLo-quality output from a single wide-field exposure without structured illumination hardware. On an independent test set of paired images, our method achieves an average PSNR of 32.2 dB and SSIM of 0.9 with respect to experimental HiLo images, gains of >13 dB in PSNR and >0.7 in SSIM over raw wide-field inputs. Compared with other methods on the same dataset, the proposed RCAN-CycleGAN consistently outperforms the unsupervised baseline CUT as well as CycleGAN variants using U-Net generators. Notably, it also shows better generalization on previously unseen in vivo mouse brain data than the supervised Pix2Pix baseline. These results demonstrate that high-fidelity optical sectioning can be achieved computationally from conventional wide-field endomicroscopy in a fully unpaired manner, enabling a compact, real-time, single-shot solution that can facilitate optically sectioned imaging in clinical and resource-limited settings.

Authors

Institutions

Publication Details

Journal
Optics Express
Published
2026-01-19
DOI
https://doi.org/10.1364/oe.586459
Primary Topic
Esophageal Cancer Research and Treatment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Single-shot optically sectioned fluorescence endomicroscopy using unsupervised RCAN-CycleGAN

Sunil Vyas, Chia Yu Lin, YU-HSIN CHIA, Yuan Luo
Optics Express
Esophageal Cancer Research and Treatment
article

Single-shot optically sectioned fluorescence endomicroscopy using unsupervised RCAN-CycleGAN

Sunil Vyas, Chia Yu Lin, YU-HSIN CHIA, Yuan Luo
article en

Abstract

Optical sectioning endomicroscopy significantly improves image contrast by rejecting out-of-focus background fluorescence, but conventional HiLo microscopy requires at least two structured-illumination exposures and, in some cases, axial scanning, which increases acquisition time and system complexity. Obtaining large, perfectly registered wide-field and HiLo image pairs for supervised deep learning is also extremely challenging in vivo. Here, we present an unsupervised RCAN-CycleGAN framework that translates single-shot wide-field fluorescence endomicroscopy images into high-contrast, optically sectioned HiLo images using only unpaired training data. Trained on unpaired wide-field and HiLo images from fluorescent beads, ex vivo mouse brain, and plant specimens, the model generates HiLo-quality output from a single wide-field exposure without structured illumination hardware. On an independent test set of paired images, our method achieves an average PSNR of 32.2 dB and SSIM of 0.9 with respect to experimental HiLo images, gains of >13 dB in PSNR and >0.7 in SSIM over raw wide-field inputs. Compared with other methods on the same dataset, the proposed RCAN-CycleGAN consistently outperforms the unsupervised baseline CUT as well as CycleGAN variants using U-Net generators. Notably, it also shows better generalization on previously unseen in vivo mouse brain data than the supervised Pix2Pix baseline. These results demonstrate that high-fidelity optical sectioning can be achieved computationally from conventional wide-field endomicroscopy in a fully unpaired manner, enabling a compact, real-time, single-shot solution that can facilitate optically sectioned imaging in clinical and resource-limited settings.

Optics ExpressVol. 34(7)
National Taiwan University (TW)
Openalex Percentile: Top 84%
Esophageal Cancer Research and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.