Hybrid Deep Reinforcement Learning for Multimodal Biomedical Signal Fusion

Improving decision-making and diagnostic accuracy in health care requires combining multimodal biomedical signals such as electrocardiograms (ECG), electroencephalograms (EEG), and medical imaging. Traditional signal fusion techniques face significant challenges due to signal variability and inherent complexity. We propose a Hybrid Deep Reinforcement Learning (HDRL) model that employs Deep Neural Networks (DNNs) for feature extraction and Reinforcement Learning (RL) for dynamic fusion optimization. This hybrid model utilizes real-time feedback to optimize fusion policy learning and adapt to varying data characteristics. To evaluate its performance, the proposed model was compared with conventional fusion techniques, such as Deep Neural Network-based methods and Principal Component Analysis (PCA). The hybrid deep reinforcement learning model was tested on several real-world biomedical datasets. The proposed model is applicable to personalised medicine and disease classification, as experimental evidence demonstrates improved performance in terms of robustness under noisy conditions, classification accuracy, and rare-event detection. The proposed methodology, in addition to addressing concerns with traditional signal fusion techniques, offers promising solutions that advance multimodal biomedical signal processing. The model uses a DNN for feature mining and RL agents (DQN, PPO) for policy optimization.

Authors

Institutions

Publication Details

Journal
Journal of Visualized Experiments
Published
2026-04-10
DOI
https://doi.org/10.3791/69929
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid Deep Reinforcement Learning for Multimodal Biomedical Signal Fusion

Miloš Janjić, Boško Nikolić, Rahul Kumar Konduru, Rajesh Sura et al.
Journal of Visualized Experiments
Emotion and Mood Recognition
article

Hybrid Deep Reinforcement Learning for Multimodal Biomedical Signal Fusion

Miloš Janjić, Boško Nikolić, Rahul Kumar Konduru, Rajesh Sura, Bhanu Prakash Reddy Rella, Nebojsa Bacanin
article en

Abstract

Improving decision-making and diagnostic accuracy in health care requires combining multimodal biomedical signals such as electrocardiograms (ECG), electroencephalograms (EEG), and medical imaging. Traditional signal fusion techniques face significant challenges due to signal variability and inherent complexity. We propose a Hybrid Deep Reinforcement Learning (HDRL) model that employs Deep Neural Networks (DNNs) for feature extraction and Reinforcement Learning (RL) for dynamic fusion optimization. This hybrid model utilizes real-time feedback to optimize fusion policy learning and adapt to varying data characteristics. To evaluate its performance, the proposed model was compared with conventional fusion techniques, such as Deep Neural Network-based methods and Principal Component Analysis (PCA). The hybrid deep reinforcement learning model was tested on several real-world biomedical datasets. The proposed model is applicable to personalised medicine and disease classification, as experimental evidence demonstrates improved performance in terms of robustness under noisy conditions, classification accuracy, and rare-event detection. The proposed methodology, in addition to addressing concerns with traditional signal fusion techniques, offers promising solutions that advance multimodal biomedical signal processing. The model uses a DNN for feature mining and RL agents (DQN, PPO) for policy optimization.

Journal of Visualized Experiments(230)
Singidunum University (RS), Anna University, Chennai (IN), University of Belgrade (RS), Data Management (Italy) (IT), Golden Gate University (US)
Openalex Percentile: Top 21%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.