Multimodal Prostate Cancer Diagnosis via Knowledge-Enhanced Deep Learning Networks

Prostate cancer remains one of the most prevalent malignancies among men worldwide, where early and accurate diagnosis significantly impacts patient outcomes. Current deep learning approaches for prostate cancer diagnosis face two fundamental limitations: heavy reliance on large-scale annotated multimodal data and insufficient incorporation of clinical expertise embedded in medical knowledge structures. These limitations often result in models that struggle to capture the nuanced relationships between imaging biomarkers, clinical indicators, and pathological states. To address these concerns, a multimodal prostate cancer diagnosis framework integrating medical knowledge graphs with deep learning is proposed, termed Multimodal Prostate Cancer Diagnosis using Knowledge-Enhanced Networks (MP-KDNet). The core architecture employs a knowledge-driven convolutional neural network that fuses heterogeneous data sources, including MRI sequences, clinical laboratory results, and patient history documentation. Through entity disambiguation and knowledge graph embedding techniques, structured clinical knowledge regarding prostate pathology is extracted and transformed into continuous vector representations. These knowledge entity vectors, alongside multimodal feature representations, serve as multi-channel inputs to the convolutional architecture. Multi-scale convolutional kernels capture diagnostic patterns across both fine-grained clinical observations and broader symptom constellations encoded in medical knowledge. Experimental validation on the MIMIC-IV dataset containing 12,847 prostate-related cases demonstrates that MP-KDNet achieves 82.7% diagnostic accuracy, outperforming conventional multimodal fusion, transformer-based imaging analysis, and knowledge graph reasoning baselines. Results confirm that integrating structured clinical expertise with patient-specific multimodal data yields more accurate discrimination among benign prostatic hyperplasia, prostatitis, and adenocarcinoma subtypes than either data-driven or knowledge-driven approaches alone.

Authors

Publication Details

Journal
Journal of Multimedia Information System
Published
2026-03-31
DOI
https://doi.org/10.33851/jmis.2026.13.1.29
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Prostate Cancer Diagnosis via Knowledge-Enhanced Deep Learning Networks

Chao Wang, Xiaodan Zhang
Journal of Multimedia Information System
Machine Learning in Healthcare
article

Multimodal Prostate Cancer Diagnosis via Knowledge-Enhanced Deep Learning Networks

Chao Wang, Xiaodan Zhang
article en

Abstract

Prostate cancer remains one of the most prevalent malignancies among men worldwide, where early and accurate diagnosis significantly impacts patient outcomes. Current deep learning approaches for prostate cancer diagnosis face two fundamental limitations: heavy reliance on large-scale annotated multimodal data and insufficient incorporation of clinical expertise embedded in medical knowledge structures. These limitations often result in models that struggle to capture the nuanced relationships between imaging biomarkers, clinical indicators, and pathological states. To address these concerns, a multimodal prostate cancer diagnosis framework integrating medical knowledge graphs with deep learning is proposed, termed Multimodal Prostate Cancer Diagnosis using Knowledge-Enhanced Networks (MP-KDNet). The core architecture employs a knowledge-driven convolutional neural network that fuses heterogeneous data sources, including MRI sequences, clinical laboratory results, and patient history documentation. Through entity disambiguation and knowledge graph embedding techniques, structured clinical knowledge regarding prostate pathology is extracted and transformed into continuous vector representations. These knowledge entity vectors, alongside multimodal feature representations, serve as multi-channel inputs to the convolutional architecture. Multi-scale convolutional kernels capture diagnostic patterns across both fine-grained clinical observations and broader symptom constellations encoded in medical knowledge. Experimental validation on the MIMIC-IV dataset containing 12,847 prostate-related cases demonstrates that MP-KDNet achieves 82.7% diagnostic accuracy, outperforming conventional multimodal fusion, transformer-based imaging analysis, and knowledge graph reasoning baselines. Results confirm that integrating structured clinical expertise with patient-specific multimodal data yields more accurate discrimination among benign prostatic hyperplasia, prostatitis, and adenocarcinoma subtypes than either data-driven or knowledge-driven approaches alone.

Journal of Multimedia Information SystemVol. 13(1)
Peace, Justice and strong institutions
Openalex Percentile: Top 23%
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.