Hybrid Diffusion Architecture for High-Fidelity Medical Image Synthesis

Medical image synthesis remains a critical challenge in biomedical engineering due to the scarcity of annotated datasets and the computational complexity of generating high-fidelity anatomical representations. This paper introduces a novel diffusion model framework designed to address these challenges through synergistic architectural innovation and dynamic parameter adaptation. Leveraging the strengths of transformer-based global context modeling and U-Net's hierarchical feature propagation, we propose the U-NetTransformer architecture—a hybrid backbone that replaces conventional convolutional modules with multi-head self-attention (MHSA) layers augmented by cross-scale feature interaction units. This design enables adaptive decoupling of structural generation and textural refinement processes, significantly improving anatomical coherence in synthesized images. To resolve inherent parameter-sharing conflicts in traditional diffusion models, we introduce the Temporal Conditional Mask Generator (TCMG), a lightweight module that dynamically activates task-specific sub-networks using learnable binary masks without requiring full model retraining. The proposed framework adopts a parameter-efficient co-optimization strategy, maintaining frozen pre-trained weights while training only mask generators and attention modules. Experimental evaluations on multi-organ CT/MRI datasets demonstrate substantial performance gains over baseline diffusion models. Clinical validation by board-certified radiologists confirms the pathological consistency and diagnostic usability of synthesized images, particularly in rare disease scenarios.

Authors

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/prmvai65741.2025.11108327
Primary Topic
Image and Signal Denoising Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid Diffusion Architecture for High-Fidelity Medical Image Synthesis

Jiarui Wang, Lu Chen
Image and Signal Denoising Methods
article

Hybrid Diffusion Architecture for High-Fidelity Medical Image Synthesis

Jiarui Wang, Lu Chen
article en

Abstract

Medical image synthesis remains a critical challenge in biomedical engineering due to the scarcity of annotated datasets and the computational complexity of generating high-fidelity anatomical representations. This paper introduces a novel diffusion model framework designed to address these challenges through synergistic architectural innovation and dynamic parameter adaptation. Leveraging the strengths of transformer-based global context modeling and U-Net's hierarchical feature propagation, we propose the U-NetTransformer architecture—a hybrid backbone that replaces conventional convolutional modules with multi-head self-attention (MHSA) layers augmented by cross-scale feature interaction units. This design enables adaptive decoupling of structural generation and textural refinement processes, significantly improving anatomical coherence in synthesized images. To resolve inherent parameter-sharing conflicts in traditional diffusion models, we introduce the Temporal Conditional Mask Generator (TCMG), a lightweight module that dynamically activates task-specific sub-networks using learnable binary masks without requiring full model retraining. The proposed framework adopts a parameter-efficient co-optimization strategy, maintaining frozen pre-trained weights while training only mask generators and attention modules. Experimental evaluations on multi-organ CT/MRI datasets demonstrate substantial performance gains over baseline diffusion models. Clinical validation by board-certified radiologists confirms the pathological consistency and diagnostic usability of synthesized images, particularly in rare disease scenarios.

Shandong Jianzhu University (CN)
Openalex Percentile: Top 80%
Image and Signal Denoising Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.