Fairness-Aware Mutual Information for Multimodal Recommendation

In recent years, multimodal recommendations have attracted considerable attention due to the increasing presence of multimedia information. Leveraging multimodal information helps alleviate the data sparsity issue in conventional recom-mender systems, thereby enhancing recommendation accuracy. However, integrating multimodal information introduces the additional challenge of managing sensitive information, as these data may implicitly or explicitly convey sensitive attributes about users, potentially exacerbating fairness issues. While existing methods have addressed fairness issues in recommender systems, most neglect the potentially sensitive information within modalities. In this light, we propose a modality-guided representation learning framework using fairness-aware mutual information to disentangle sensitive and non-sensitive information from modal embeddings. Specifically, we adopt a dual mutual information objective to decompose modal embeddings, capturing sensitive information while encouraging embeddings to contain as much non-sensitive information as possible. These disentangled embeddings are then used to enhance user representations. Extensive experiments on two public datasets have demonstrated the effectiveness of our approach.

Authors

Institutions

Publication Details

Published
2024-08-16
DOI
https://doi.org/10.1109/besc64747.2024.10780480
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fairness-Aware Mutual Information for Multimodal Recommendation

Rui‐Pin Chen, Guandong Xu, Dan Lu, Shiqing Wu et al.
Recommender Systems and Techniques
article

Fairness-Aware Mutual Information for Multimodal Recommendation

Rui‐Pin Chen, Guandong Xu, Dan Lu, Shiqing Wu, Xu Chen
article en

Abstract

In recent years, multimodal recommendations have attracted considerable attention due to the increasing presence of multimedia information. Leveraging multimodal information helps alleviate the data sparsity issue in conventional recom-mender systems, thereby enhancing recommendation accuracy. However, integrating multimodal information introduces the additional challenge of managing sensitive information, as these data may implicitly or explicitly convey sensitive attributes about users, potentially exacerbating fairness issues. While existing methods have addressed fairness issues in recommender systems, most neglect the potentially sensitive information within modalities. In this light, we propose a modality-guided representation learning framework using fairness-aware mutual information to disentangle sensitive and non-sensitive information from modal embeddings. Specifically, we adopt a dual mutual information objective to decompose modal embeddings, capturing sensitive information while encouraging embeddings to contain as much non-sensitive information as possible. These disentangled embeddings are then used to enhance user representations. Extensive experiments on two public datasets have demonstrated the effectiveness of our approach.

University of Technology Sydney (AU), Harbin Engineering University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 64%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.