Lightweight CycleGAN models for cross-modality image transformation and experimental quality assessment in fluorescence microscopy

With the growing integration of artificial intelligence in scientific and medical applications, lightweight deep learning models have become increasingly important. These models offer substantial reductions in memory usage and computational time. Given that GPU-based model training and inference contribute significantly to carbon emissions, lightweight architectures with comparable performance to parameter-rich models present a more environmentally friendly alternative. Specifically, we build upon CycleGAN with a fixed-channel lightweight U-Net generator for modality transfer from standard confocal to super-resolution STED and deconvolved STED images, and systematically compare it against Pix2Pix and standard CycleGAN baselines. Obtaining paired datasets in medical imaging and super-resolution microscopy is often infeasible due to the need for additional experiments and the intrinsic complexity of biological sample preparation. To address this, we investigate the performance of lightweight CycleGAN models, demonstrating their ability to achieve high-fidelity modality transfer despite reduced model complexity. We introduce a fixed channel strategy within the U-Net-based generator, in contrast to the traditional channel-doubling approach. This modification significantly reduces the number of trainable parameters from 41.8 million to approximately 9 thousand, while achieving comparable or slightly improved performance. We explore the utility of GAN models as a qualitative marker for assessing experimental and labeling quality. When trained on high-quality microscopy images, the GAN implicitly learns the characteristics of optimal imaging. Deviations between GAN-generated outputs trained on high-quality data and low-quality experimental images can highlight potential issues such as photobleaching, experimental artifacts, or inaccurate labeling. In this way, the model can support qualitative assessment of experimental consistency and image fidelity in fluorescence microscopy workflows.

Authors

Institutions

Publication Details

Published
2026-05-29
DOI
https://doi.org/10.1117/12.3099385
Primary Topic
Cell Image Analysis Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Lightweight CycleGAN models for cross-modality image transformation and experimental quality assessment in fluorescence microscopy

Mohammad Soltaninezhad
Cell Image Analysis Techniques
article

Lightweight CycleGAN models for cross-modality image transformation and experimental quality assessment in fluorescence microscopy

Mohammad Soltaninezhad
article en

Abstract

With the growing integration of artificial intelligence in scientific and medical applications, lightweight deep learning models have become increasingly important. These models offer substantial reductions in memory usage and computational time. Given that GPU-based model training and inference contribute significantly to carbon emissions, lightweight architectures with comparable performance to parameter-rich models present a more environmentally friendly alternative. Specifically, we build upon CycleGAN with a fixed-channel lightweight U-Net generator for modality transfer from standard confocal to super-resolution STED and deconvolved STED images, and systematically compare it against Pix2Pix and standard CycleGAN baselines. Obtaining paired datasets in medical imaging and super-resolution microscopy is often infeasible due to the need for additional experiments and the intrinsic complexity of biological sample preparation. To address this, we investigate the performance of lightweight CycleGAN models, demonstrating their ability to achieve high-fidelity modality transfer despite reduced model complexity. We introduce a fixed channel strategy within the U-Net-based generator, in contrast to the traditional channel-doubling approach. This modification significantly reduces the number of trainable parameters from 41.8 million to approximately 9 thousand, while achieving comparable or slightly improved performance. We explore the utility of GAN models as a qualitative marker for assessing experimental and labeling quality. When trained on high-quality microscopy images, the GAN implicitly learns the characteristics of optimal imaging. Deviations between GAN-generated outputs trained on high-quality data and low-quality experimental images can highlight potential issues such as photobleaching, experimental artifacts, or inaccurate labeling. In this way, the model can support qualitative assessment of experimental consistency and image fidelity in fluorescence microscopy workflows.

Vol. 17(3)
Leibniz Institute of Photonic Technology (DE)
Friedrich-Schiller-Universität Jena, Freistaat Thüringen, European Commission, Deutsche Forschungsgemeinschaft, Fonds National de la Recherche Luxembourg, Fonds Wetenschappelijk Onderzoek, Thüringer Aufbaubank, Thüringer Ministerium für Wirtschaft, Wissenschaft und Digitale Gesellschaft, Leibniz-Gemeinschaft, European Regional Development Fund
Openalex Percentile: Top 100%
Cell Image Analysis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.