Bias-Aware Multi-Modal Graph Neural Network for Recommendation Systems

Existing multimodal recommendation systems generally consider information from multiple modalities, using pre-trained networks for initial feature extraction, followed by the application of graph neural networks (GNNs) for further feature propagation across nodes. The extracted features from each modality are then fused to generate the final recommendation score. However, this fusion approach often overlooks the global graph information and the impact of imbalanced modality information on the fusion process. While some fusion methods consider the heterogeneous information between modalities, they tend to neglect the internal variations within each modality. To address this, this paper proposes a Multimodal Dispersive Bias Alignment Network (MDBA), which integrates multimodal graph neural networks. The model separately considers the feature information of nodes at both the modality-level and within each modality to compute cross-modal bias and internal dispersion. By quantifying the importance of different modalities and intra-modality features through cross-modal bias and internal dispersion, the model achieves more fine-grained control over the fusion process.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1145/3708394.3708412
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bias-Aware Multi-Modal Graph Neural Network for Recommendation Systems

Jian Zheng, Fei Wang
Recommender Systems and Techniques
article

Bias-Aware Multi-Modal Graph Neural Network for Recommendation Systems

Jian Zheng, Fei Wang
article en

Abstract

Existing multimodal recommendation systems generally consider information from multiple modalities, using pre-trained networks for initial feature extraction, followed by the application of graph neural networks (GNNs) for further feature propagation across nodes. The extracted features from each modality are then fused to generate the final recommendation score. However, this fusion approach often overlooks the global graph information and the impact of imbalanced modality information on the fusion process. While some fusion methods consider the heterogeneous information between modalities, they tend to neglect the internal variations within each modality. To address this, this paper proposes a Multimodal Dispersive Bias Alignment Network (MDBA), which integrates multimodal graph neural networks. The model separately considers the feature information of nodes at both the modality-level and within each modality to compute cross-modal bias and internal dispersion. By quantifying the importance of different modalities and intra-modality features through cross-modal bias and internal dispersion, the model achieves more fine-grained control over the fusion process.

Shanghai Polytechnic University (CN)
Openalex Percentile: Top 59%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.