Image and text recommendation system based on multimodal feature fusion

With the growing importance of multimodal data in recommendation systems, effectively integrating heterogeneous information—such as user behavior, text, and images—remains a key challenge. This paper proposes GFSAM (Graph-Fusion with Samformer for Multimodal Recommendation), a framework that enhances semantic integrity and training stability through structural modeling and optimization. GFSAM incorporates a structure-aware graph fusion module for aligning multimodal features via role embedding and adjacency perception, and integrates the Samformer module—combining RevIN and channel attention—to improve cross-modal representation and expression depth. Experiments on three datasets show that GFSAM achieves average gains of 3.86% in Recall and 5.42% in NDCG, demonstrating superior adaptability, robustness in sparse or heterogeneous scenarios, and improved training efficiency (e.g., 2.89 seconds per iteration on the Sports subset).

Authors

Institutions

Publication Details

Published
2025-08-08
DOI
https://doi.org/10.1109/iaeac65194.2025.11166070
Primary Topic
Educational Technology and Pedagogy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Image and text recommendation system based on multimodal feature fusion

Shuang Luo, Qun Hou, Yiming Wang, Cheng Zhao et al.
Educational Technology and Pedagogy
article

Image and text recommendation system based on multimodal feature fusion

Shuang Luo, Qun Hou, Yiming Wang, Cheng Zhao, S.T. Tan, Yumin Dai
article en

Abstract

With the growing importance of multimodal data in recommendation systems, effectively integrating heterogeneous information—such as user behavior, text, and images—remains a key challenge. This paper proposes GFSAM (Graph-Fusion with Samformer for Multimodal Recommendation), a framework that enhances semantic integrity and training stability through structural modeling and optimization. GFSAM incorporates a structure-aware graph fusion module for aligning multimodal features via role embedding and adjacency perception, and integrates the Samformer module—combining RevIN and channel attention—to improve cross-modal representation and expression depth. Experiments on three datasets show that GFSAM achieves average gains of 3.86% in Recall and 5.42% in NDCG, demonstrating superior adaptability, robustness in sparse or heterogeneous scenarios, and improved training efficiency (e.g., 2.89 seconds per iteration on the Sports subset).

Jianghan University (CN)
Openalex Percentile: Top 86%
Educational Technology and Pedagogy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.