Structured Conditioning and Multiscale Generation of Cell Microscopy Images for Segmentation Data Augmentation

Generating cell microscopy images across sources requires balancing appearance quality, conditional response, and structural preservation. We developed a multiscale conditional diffusion model (MSCDM) for text-conditioned generation without spatial references and foreground generation given contours and backgrounds. Three text segments condition three diffusion scales. For foreground generation, parameter interpolation between a base model and a class-distribution teacher forms a shared backbone; after freezing it, teacher predictions supervise sparse feature modulation gated by reference and target classes. Evaluation covered five imaging configurations from four public datasets. Fréchet Inception distances were 53.729 for 10,000 text-generated images and 25.076 for 4000 same-class foreground resyntheses, the lowest in their respective comparisons, with reference-fidelity trade-offs. Evaluator-defined classification accuracy for fixed-anchor cross-class requests was 85.0% (153/180). Across two HeLa sequences, mixed real and same-class synthetic training data improved instance-matching mean average precision (mAP) in both transfer directions. The bidirectional macro-average gain over real-data training was 1.359 percentage points across three paired seeds, with matched updates and effective batch sizes. These findings support foreground appearance augmentation within existing real backgrounds, layouts, and annotations.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2026-11-18
DOI
https://doi.org/10.3390/electronics15225384
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Structured Conditioning and Multiscale Generation of Cell Microscopy Images for Segmentation Data Augmentation

Bin Shen, Zhen Gu, Bingyong Yan, Jiale Zhou et al.
2 links
Electronics
Generative Adversarial Networks and Image Synthesis
article

Structured Conditioning and Multiscale Generation of Cell Microscopy Images for Segmentation Data Augmentation

Bin Shen, Zhen Gu, Bingyong Yan, Jiale Zhou, Huifeng Wang, Hang Xu
article en

Abstract

Generating cell microscopy images across sources requires balancing appearance quality, conditional response, and structural preservation. We developed a multiscale conditional diffusion model (MSCDM) for text-conditioned generation without spatial references and foreground generation given contours and backgrounds. Three text segments condition three diffusion scales. For foreground generation, parameter interpolation between a base model and a class-distribution teacher forms a shared backbone; after freezing it, teacher predictions supervise sparse feature modulation gated by reference and target classes. Evaluation covered five imaging configurations from four public datasets. Fréchet Inception distances were 53.729 for 10,000 text-generated images and 25.076 for 4000 same-class foreground resyntheses, the lowest in their respective comparisons, with reference-fidelity trade-offs. Evaluator-defined classification accuracy for fixed-anchor cross-class requests was 85.0% (153/180). Across two HeLa sequences, mixed real and same-class synthetic training data improved instance-matching mean average precision (mAP) in both transfer directions. The bidirectional macro-average gain over real-data training was 1.359 percentage points across three paired seeds, with matched updates and effective batch sizes. These findings support foreground appearance augmentation within existing real backgrounds, layouts, and annotations.

ElectronicsVol. 15(22)
East China University of Science and Technology (CN), State Key Laboratory of Bioreactor Engineering (CN), Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education (CN)
National Key Research and Development Program of China
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon