Image and text recommendation system based on multimodal feature fusion
With the growing importance of multimodal data in recommendation systems, effectively integrating heterogeneous information—such as user behavior, text, and images—remains a key challenge. This paper proposes GFSAM (Graph-Fusion with Samformer for Multimodal Recommendation), a framework that enhances semantic integrity and training stability through structural modeling and optimization. GFSAM incorporates a structure-aware graph fusion module for aligning multimodal features via role embedding and adjacency perception, and integrates the Samformer module—combining RevIN and channel attention—to improve cross-modal representation and expression depth. Experiments on three datasets show that GFSAM achieves average gains of 3.86% in Recall and 5.42% in NDCG, demonstrating superior adaptability, robustness in sparse or heterogeneous scenarios, and improved training efficiency (e.g., 2.89 seconds per iteration on the Sports subset).
Authors
- Shuang Luo (ORCID: https://orcid.org/0000-0003-3832-0475)
- Qun Hou (ORCID: https://orcid.org/0000-0003-3204-1547)
- Yiming Wang (ORCID: https://orcid.org/0000-0002-5932-4371)
- Cheng Zhao (ORCID: https://orcid.org/0009-0001-9583-6243)
- S.T. Tan (ORCID: https://orcid.org/0000-0003-0418-3441)
- Yumin Dai (ORCID: https://orcid.org/0009-0001-5402-6658)
Institutions
- Jianghan University (CN)
Publication Details
- Published
- 2025-08-08
- DOI
- https://doi.org/10.1109/iaeac65194.2025.11166070
- Primary Topic
- Educational Technology and Pedagogy
- Type
- article
- Field-Weighted Citation Impact
- 0.00