Multimodal Medical Image Generation and Classification via Generative Adversarial Networks

Medical image analysis is essential for accurate disease diagnosis, with multimodal imaging offering complementary information to enhance diagnostic precision. However, current GAN architectures exhibit limitations in feature fusion efficiency, synthesized image quality, and classification accuracy. In this study, a GAN-based multimodal medical image generation and classification model was constructed. First, features are extracted using multi-scale receptive fields, key channels are enhanced by combining the channel attention mechanism, and the cross-enhanced fusion module realizes the fusion of MRI and PET features. In addition, Generator 3D is responsible for generating realistic medical images and classifying diseases through the classification header. Discriminator 3D is used to discriminate the realism of the images. Meanwhile, a comprehensive loss function is designed to optimize the generator's performance by combining adversarial loss, correlation loss, mean loss, and classification loss. The experimental results show that the proposed method can generate high-quality medical images and perform well on the classification task. It effectively improves the performance of medical image analysis and provides strong support for clinical diagnosis.

Authors

Institutions

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1145/3734921.3734945
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Medical Image Generation and Classification via Generative Adversarial Networks

Y Zhang
1 links
AI in cancer detection
article

Multimodal Medical Image Generation and Classification via Generative Adversarial Networks

Y Zhang
article en

Abstract

Medical image analysis is essential for accurate disease diagnosis, with multimodal imaging offering complementary information to enhance diagnostic precision. However, current GAN architectures exhibit limitations in feature fusion efficiency, synthesized image quality, and classification accuracy. In this study, a GAN-based multimodal medical image generation and classification model was constructed. First, features are extracted using multi-scale receptive fields, key channels are enhanced by combining the channel attention mechanism, and the cross-enhanced fusion module realizes the fusion of MRI and PET features. In addition, Generator 3D is responsible for generating realistic medical images and classifying diseases through the classification header. Discriminator 3D is used to discriminate the realism of the images. Meanwhile, a comprehensive loss function is designed to optimize the generator's performance by combining adversarial loss, correlation loss, mean loss, and classification loss. The experimental results show that the proposed method can generate high-quality medical images and perform well on the classification task. It effectively improves the performance of medical image analysis and provides strong support for clinical diagnosis.

Hainan Normal University (CN)
Openalex Percentile: Top 93%
AI in cancer detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.