Modality-Independent Graph Neural Networks with Global Transformers for Multimodal Recommendation

Multimodal recommendation systems can learn users' preferences from existing user-item interactions as well as the semantics of multimodal data associated with items. Many existing methods model this through a multimodal user-item graph, approaching multimodal recommendation as a graph learning task. Graph Neural Networks (GNNs) have shown promising performance in this domain. Prior research has capitalized on GNNs' capability to capture neighborhood information within certain receptive fields (typically denoted by the number of hops, K) to enrich user and item semantics. We observe that the optimal receptive fields for GNNs can vary across different modalities. In this paper, we propose GNNs with Modality-Independent Receptive Fields, which employ separate GNNs with independent receptive fields for different modalities to enhance performance. Our results indicate that the optimal K for certain modalities on specific datasets can be as low as 1 or 2, which may restrict the GNNs' capacity to capture global information. To address this, we introduce a Sampling-based Global Transformer, which utilizes uniform global sampling to effectively integrate global information for GNNs. We conduct comprehensive experiments that demonstrate the superiority of our approach over existing methods.

Authors

Institutions

Publication Details

Journal
Proceedings of the AAAI Conference on Artificial Intelligence
Published
2025-04-11
DOI
https://doi.org/10.1609/aaai.v39i11.33283
Citations
5
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
4.43

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Modality-Independent Graph Neural Networks with Global Transformers for Multimodal Recommendation

Yinwei Wei, Bingsheng He, Bryan Hooi, Junhui Hu
5 citations
Proceedings of the AAAI Conference on Artificial Intelligence
Advanced Graph Neural Networks
4.43
article

Modality-Independent Graph Neural Networks with Global Transformers for Multimodal Recommendation

Yinwei Wei, Bingsheng He, Bryan Hooi, Junhui Hu
article en
5 citations

Abstract

Multimodal recommendation systems can learn users' preferences from existing user-item interactions as well as the semantics of multimodal data associated with items. Many existing methods model this through a multimodal user-item graph, approaching multimodal recommendation as a graph learning task. Graph Neural Networks (GNNs) have shown promising performance in this domain. Prior research has capitalized on GNNs' capability to capture neighborhood information within certain receptive fields (typically denoted by the number of hops, K) to enrich user and item semantics. We observe that the optimal receptive fields for GNNs can vary across different modalities. In this paper, we propose GNNs with Modality-Independent Receptive Fields, which employ separate GNNs with independent receptive fields for different modalities to enhance performance. Our results indicate that the optimal K for certain modalities on specific datasets can be as low as 1 or 2, which may restrict the GNNs' capacity to capture global information. To address this, we introduce a Sampling-based Global Transformer, which utilizes uniform global sampling to effectively integrate global information for GNNs. We conduct comprehensive experiments that demonstrate the superiority of our approach over existing methods.

Proceedings of the AAAI Conference on Artificial IntelligenceVol. 39(11)
Shandong University (CN), National University of Singapore (SG)
National Research Foundation, National Research Foundation Singapore, National Natural Science Foundation of China, Info-communications Media Development Authority
Openalex Percentile: Top 5%
Advanced Graph Neural Networks
4.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Modality-Independent Graph Neural Networks with Global Transformers for Multimodal Recommendation — Yinwei Wei, Bingsheng He, et al. · Proceedings of the AAAI Conference on Artificial Intelligence (2025) | TGRS Research Map | TGRS