A Novel Multi-modal Recommender with Modality-Specific Graph Refining Strategy

Recommender system (RecSys) have become essential in various domains, leveraging user-item interaction data to provide personalized suggestions. Collaborative filtering (CF) techniques, while effective, are often limited by the sparsity of historical data. To address this issue, multi-modal recommender systems (MMRec) integrate visual, audio, and textual information to enrich user and item representations, thus improving recommendation accuracy. However, recent advancements in GCNs-based MMRec merely constructed identical bipartite graphs for each modality, ignoring the semantic gap among different modalities, and eventually leading to sub-optimal recommendation.In this work, we propose a novel Multi-Modal Light Graph-Refining Convolutional Network (MMLGRN) recommender that constructs distinct user-item graphs for each modality. Specifically, MMLGRN employs pruning strategies to refine graph structures based on modality features. By learning modality-specific collaborative signals from different graphs and aggregating multi-modal embeddings, MMLGRN is able to deliver customized recommendations that cater to user’s preferences. Experimental results on a public dataset demonstrate that MMLGRN outperforms state-of-the-art baselines, validating the effectiveness of the proposed graph refining strategy.

Authors

Institutions

Publication Details

Published
2024-08-25
DOI
https://doi.org/10.1109/cost64302.2024.00077
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Novel Multi-modal Recommender with Modality-Specific Graph Refining Strategy

Cheng Yang, Zhiyi Chen, Yunfei Liang, Peng Yi et al.
Text and Document Classification Technologies
article

A Novel Multi-modal Recommender with Modality-Specific Graph Refining Strategy

Cheng Yang, Zhiyi Chen, Yunfei Liang, Peng Yi, Zhaoxian Li, Lixiang Hou
article en

Abstract

Recommender system (RecSys) have become essential in various domains, leveraging user-item interaction data to provide personalized suggestions. Collaborative filtering (CF) techniques, while effective, are often limited by the sparsity of historical data. To address this issue, multi-modal recommender systems (MMRec) integrate visual, audio, and textual information to enrich user and item representations, thus improving recommendation accuracy. However, recent advancements in GCNs-based MMRec merely constructed identical bipartite graphs for each modality, ignoring the semantic gap among different modalities, and eventually leading to sub-optimal recommendation.In this work, we propose a novel Multi-Modal Light Graph-Refining Convolutional Network (MMLGRN) recommender that constructs distinct user-item graphs for each modality. Specifically, MMLGRN employs pruning strategies to refine graph structures based on modality features. By learning modality-specific collaborative signals from different graphs and aggregating multi-modal embeddings, MMLGRN is able to deliver customized recommendations that cater to user’s preferences. Experimental results on a public dataset demonstrate that MMLGRN outperforms state-of-the-art baselines, validating the effectiveness of the proposed graph refining strategy.

Communication University of China (CN)
Openalex Percentile: Top 87%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Novel Multi-modal Recommender with Modality-Specific Graph Refining Strategy — Cheng Yang, Zhiyi Chen, et al. · (2024) | TGRS Research Map | TGRS