A conflict-aware hybrid quantum residual network for multimodal fusion
Abstract Multimodal learning aims to integrate complementary cues from different information sources to obtain more comprehensive and discriminative representations than those from a single modality. However, existing deep multimodal fusion methods often construct joint representations through feature concatenation, attention-based interactions or multi-stage fusion structures. Cross-modal conflicts are often implicitly compressed into high-dimensional features, which limits the interpretability of the fusion process. These designs may also introduce additional parameter overhead. To address these issues, this paper proposes a conflict-aware hybrid quantum residual network for multimodal fusion, namely the Hybrid Quantum Evidential Network (HQEN). HQEN extracts modality features through lightweight Dual-Modal Classical Encoders and uses an evidence-inspired shared-private decoupling mechanism to compress them into low-dimensional evidence descriptors with shared-private components. Before quantum encoding, conflict-aware phase mapping explicitly characterizes the conflict between the two modality descriptors. The resulting descriptors and conflict phase are encoded into different rotation channels of a parameterized quantum circuit. Rather than serving as an independent classifier, the quantum circuit acts as a quantum residual branch over the classical decision base, providing nonlinear correction in a low-dimensional evidence space. This design reduces the burden on a small-scale quantum circuit for complete multi-class prediction while keeping the model compact. Experimental results show that HQEN achieves competitive classification performance with a small parameter scale and a favorable accuracy--parameter trade-off. Ablation studies, conflict-stratified analysis and quantum residual output sensitivity analysis further support the roles of the evidence interface, conflict-aware phase and quantum residual branch. HQEN is trained and evaluated through classical quantum-circuit simulation, and the results support it as a compact hybrid quantum--classical modeling framework.
Authors
- Ri‐Gui Zhou (ORCID: https://orcid.org/0000-0002-8894-8108)
- Wenshan Xu (ORCID: https://orcid.org/0000-0003-0088-0338)
- Yaochong Li (ORCID: https://orcid.org/0000-0002-1474-9800)
- Yihe Wang
Institutions
- Shanghai Maritime University (CN)
Publication Details
- Journal
- Physica Scripta
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1088/1402-4896/aec333
- Primary Topic
- Quantum Computing Algorithms and Architecture
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China