EFM-GAN: enhanced feature modeling for multimodal MRI synthesis under missing-modality settings

Abstract Objective . Multimodal magnetic resonance imaging (MRI) synthesis has been widely investigated for recovering unavailable imaging modalities under incomplete acquisition scenarios. However, existing approaches often rely on implicit feature fusion strategies, where modality-specific appearance information and cross-modal anatomical representations are entangled in a shared latent space. Such entanglement may lead to unstable feature interaction and limit the preservation of modality-invariant structural information. Moreover, although multimodal MRI sequences are generally spatially registered, modality-specific acquisition mechanisms introduce heterogeneous feature distributions, leading to feature-level semantic inconsistency during cross-modal representation learning. Lesion-related details are also frequently underrepresented, particularly in anatomically complex regions that are difficult to reconstruct. Approach . To address these limitations, an enhanced feature modeling generative adversarial network (EFM-GAN) is proposed with an explicit parallel feature modeling framework. In EFM-GAN, parallel feature branches explicitly model modality-specific appearance and cross-modal shared representations. A bidirectional progressive alignment module is further introduced to progressively reduce feature-level semantic discrepancies between modality-specific representations before feature fusion, while preserving modality-dependent appearance information. Furthermore, a reconstruction difficulty-aware loss is designed to adaptively reweight reconstruction constraints, assigning greater emphasis to regions that are harder to reconstruct. Main results . Extensive experiments on the BRaTS2020 and BRaTS2021 datasets demonstrate that EFM-GAN achieves higher peak signal-to-noise ratio and structural similarity index than the evaluated baseline methods across multiple target modalities, with improved structural consistency and synthesis fidelity. Significance . The results demonstrate the effectiveness of explicitly modeling modality-specific and shared representations, progressively aligning heterogeneous features, and emphasizing reconstruction-difficult regions for missing-modality MRI synthesis.

Authors

Institutions

Publication Details

Journal
Physics in Medicine and Biology
Published
2026-11-11
DOI
https://doi.org/10.1088/1361-6560/aebd5f
Primary Topic
Advanced MRI Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

EFM-GAN: enhanced feature modeling for multimodal MRI synthesis under missing-modality settings

Xin Song, Siyang Xu, Quanqi Liu, YiMin Wang et al.
Physics in Medicine and Biology
Advanced MRI Techniques and Applications
article

EFM-GAN: enhanced feature modeling for multimodal MRI synthesis under missing-modality settings

Xin Song, Siyang Xu, Quanqi Liu, YiMin Wang, Ke Wang, JiaYi Ma
article en

Abstract

Abstract Objective . Multimodal magnetic resonance imaging (MRI) synthesis has been widely investigated for recovering unavailable imaging modalities under incomplete acquisition scenarios. However, existing approaches often rely on implicit feature fusion strategies, where modality-specific appearance information and cross-modal anatomical representations are entangled in a shared latent space. Such entanglement may lead to unstable feature interaction and limit the preservation of modality-invariant structural information. Moreover, although multimodal MRI sequences are generally spatially registered, modality-specific acquisition mechanisms introduce heterogeneous feature distributions, leading to feature-level semantic inconsistency during cross-modal representation learning. Lesion-related details are also frequently underrepresented, particularly in anatomically complex regions that are difficult to reconstruct. Approach . To address these limitations, an enhanced feature modeling generative adversarial network (EFM-GAN) is proposed with an explicit parallel feature modeling framework. In EFM-GAN, parallel feature branches explicitly model modality-specific appearance and cross-modal shared representations. A bidirectional progressive alignment module is further introduced to progressively reduce feature-level semantic discrepancies between modality-specific representations before feature fusion, while preserving modality-dependent appearance information. Furthermore, a reconstruction difficulty-aware loss is designed to adaptively reweight reconstruction constraints, assigning greater emphasis to regions that are harder to reconstruct. Main results . Extensive experiments on the BRaTS2020 and BRaTS2021 datasets demonstrate that EFM-GAN achieves higher peak signal-to-noise ratio and structural similarity index than the evaluated baseline methods across multiple target modalities, with improved structural consistency and synthesis fidelity. Significance . The results demonstrate the effectiveness of explicitly modeling modality-specific and shared representations, progressively aligning heterogeneous features, and emphasizing reconstruction-difficult regions for missing-modality MRI synthesis.

Physics in Medicine and BiologyVol. 71(21)
First Hospital of Qinhuangdao (CN), Northeastern University (CN)
Advanced MRI Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon