Knowledge-Aware Diffusion-Enhanced Multimedia Recommendation
Multimedia recommendations aim to use rich multimedia content to enhance historical user-item interaction information, which can not only indicate the content relatedness among items but also reveal finer-grained preferences of users. In this paper, we propose a <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">K</u>nowledge-aware <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Diff</u>usion-<underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">E</u>nhanced architecture using contrastive learning paradigms (KDiffE) for multimedia recommendations. Specifically, we first utilize original user-item graphs to build an attention-aware matrix into graph neural networks, which can learn the importance between users and items for main view construction. The attention-aware matrix is constructed by adopting a random walk with a restart strategy, which can preserve the importance between users and items to generate aggregation of attention-aware node features. Then, we propose a guided diffusion model to generate strongly task-relevant knowledge graphs with less noise for constructing a knowledge-aware contrastive view, which utilizes user embeddings with an edge connected to an item to guide the generation of strongly task-relevant knowledge graphs for enhancing the item's semantic information. We perform comprehensive experiments on three multimedia datasets that reveal the effectiveness of our KDiffE and its components on various state-of-the-art methods. Our source codes are available.
Authors
- Xian Mo (ORCID: https://orcid.org/0000-0002-1249-9190)
- Rui Tang (ORCID: https://orcid.org/0000-0002-3112-4861)
- Gao Jintao (ORCID: https://orcid.org/0000-0002-2206-2013)
- Hao Liu (ORCID: https://orcid.org/0000-0003-0954-5405)
- Liu Fei (ORCID: https://orcid.org/0000-0001-7603-9436)
Institutions
- Ningxia University (CN)
- Sichuan University (CN)
Publication Details
- Journal
- IEEE Transactions on Multimedia
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tmm.2025.3613108
- Citations
- 1
- Primary Topic
- Image Retrieval and Classification Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.28