SAMRec: Self-Attention Based Multimodal Recommendation

With the development of multimedia platforms, traditional recommendation systems that rely on historical user-item interactions are no longer sufficient for most platforms' demand for precise recommendations, as they fail to leverage item modality information. Multimodal recommendation is a method that combines historical user-item interaction data with multimodal item information to better capture user preferences. Existing multimodal recommendation methods often treat item modality information in a simplistic manner, typically using pretrained models to extract features, without deeply exploring the relationships between various modality information. To address this issue, we propose a multimodal recommendation model based on the self-attention mechanism, which effectively captures the global relationships among the multiple item modality features that users have interacted with, thereby more accurately modeling user preferences. Additionally, to prevent the loss of relatively important information when using the self-attention mechanism, we incorporate skip connect to linearly combine the original modality features, ensuring that all critical information is retained while improving the global feature representation. The experimental results show that the self-attention mechanism greatly improves the model's capacity to better capture user preferences, resulting in increased recommendation accuracy. We evaluate the suggested model on three publicly available datasets.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icvisp64524.2024.10959381
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SAMRec: Self-Attention Based Multimodal Recommendation

Mei Jia, Yajie Gu, Cheng Zhang, Yiming Zhao et al.
Topic Modeling
article

SAMRec: Self-Attention Based Multimodal Recommendation

Mei Jia, Yajie Gu, Cheng Zhang, Yiming Zhao, Mingjie Wang, Jun Wang
article en

Abstract

With the development of multimedia platforms, traditional recommendation systems that rely on historical user-item interactions are no longer sufficient for most platforms' demand for precise recommendations, as they fail to leverage item modality information. Multimodal recommendation is a method that combines historical user-item interaction data with multimodal item information to better capture user preferences. Existing multimodal recommendation methods often treat item modality information in a simplistic manner, typically using pretrained models to extract features, without deeply exploring the relationships between various modality information. To address this issue, we propose a multimodal recommendation model based on the self-attention mechanism, which effectively captures the global relationships among the multiple item modality features that users have interacted with, thereby more accurately modeling user preferences. Additionally, to prevent the loss of relatively important information when using the self-attention mechanism, we incorporate skip connect to linearly combine the original modality features, ensuring that all critical information is retained while improving the global feature representation. The experimental results show that the self-attention mechanism greatly improves the model's capacity to better capture user preferences, resulting in increased recommendation accuracy. We evaluate the suggested model on three publicly available datasets.

Yunnan Normal University (CN)
Openalex Percentile: Top 73%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.