Multi-modal Knowledge Graph Recommendation based on Self-Supervised Learning

Incorporating multi-modal information into user-item interaction graphs has emerged as a promising strategy to improve recommendation quality by capturing richer semantic relationships. This paper introduces a novel framework that uses bootstrap latent representations improved by contrastive learning to integrate multi-modal knowledge graphs into the recommendation process. Contrastive learning addresses the cold-start problem by maximizing mutual dependencies between item content and collaborative signals [1]. We construct a comprehensive multi-modal knowledge graph by enriching the user-item interaction graph with structured knowledge, images, and textual data. After encoding both user-item interactions and multi-modal information, we propose a self-supervised learning paradigm that eliminates the need for negative sampling and complex data augmentations, thereby reducing computational overhead. Our model incorporates a contrastive view generator and leverages multiple loss functions—including graph reconstruction loss, inter-modality feature alignment loss, and intra-modality feature masking loss—to learn robust and discriminative representations. Our methodology offers improved accuracy and efficiency compared to existing methods, as demonstrated by experimental results on standard recommendation benchmarks. It also outperforms them significantly. This study highlights the effectiveness of combining multi-modal knowledge graphs and contrastive learning to enhance recommendation systems.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/icftic64248.2024.10913022
Citations
1
Primary Topic
Technology and Data Analysis
Type
article
Field-Weighted Citation Impact
0.78
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-modal Knowledge Graph Recommendation based on Self-Supervised Learning

Yuhan Hu, Li Li, Cheng Yan, Qian Xia
1 citations
Technology and Data Analysis
0.78
article

Multi-modal Knowledge Graph Recommendation based on Self-Supervised Learning

Yuhan Hu, Li Li, Cheng Yan, Qian Xia
article en
1 citations

Abstract

Incorporating multi-modal information into user-item interaction graphs has emerged as a promising strategy to improve recommendation quality by capturing richer semantic relationships. This paper introduces a novel framework that uses bootstrap latent representations improved by contrastive learning to integrate multi-modal knowledge graphs into the recommendation process. Contrastive learning addresses the cold-start problem by maximizing mutual dependencies between item content and collaborative signals [1]. We construct a comprehensive multi-modal knowledge graph by enriching the user-item interaction graph with structured knowledge, images, and textual data. After encoding both user-item interactions and multi-modal information, we propose a self-supervised learning paradigm that eliminates the need for negative sampling and complex data augmentations, thereby reducing computational overhead. Our model incorporates a contrastive view generator and leverages multiple loss functions—including graph reconstruction loss, inter-modality feature alignment loss, and intra-modality feature masking loss—to learn robust and discriminative representations. Our methodology offers improved accuracy and efficiency compared to existing methods, as demonstrated by experimental results on standard recommendation benchmarks. It also outperforms them significantly. This study highlights the effectiveness of combining multi-modal knowledge graphs and contrastive learning to enhance recommendation systems.

Xinjiang University (CN)
Openalex Percentile: Top 17%
Technology and Data Analysis
0.78
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.