FLRF: Federated recommendation optimization for long-tail data distribution

Recommendation systems play a crucial role in real-world applications. Federated learning allows training recommendation systems without revealing users’ private data, thereby protecting user privacy. As a result, federated recommendation systems have gained increasing attention in recent years. However, The long-tail distribution problem of federated recommendation systems has not received enough attention. A small number of popular items receive most of the users’ attention, while a significantly larger number of less popular items receive feedback from only a small portion of users. Existing federated recommendation systems usually train on datasets with a long-tail distribution, which can easily lead to over fitting on a small number of popular items, reducing the diversity and novelty of recommendations and causing popularity bias. This paper proposes FLRF, a Federated Long-tail Recommendation Framework, which consists a long-tail recommendation model based on disentangled learning and a long-tail-aware aggregation method based on the attention mechanism. The long-tail recommendation model utilizes the idea of disentangled representation learning to explicitly disentangle the attractiveness of items into fame and niche. The long-tail-aware model aggregation, performs global attention aggregation on the model parameters of the fame part and self-attention aggregation on the model parameters of the niche part. We conduct comparative experiments on the three real-world datasets against the baseline methods in terms of accuracy and novelty. The experimental results show that the proposed framework can improve the diversity and novelty of recommendations without significantly impacting recommendation accuracy.

Authors

Institutions

Publication Details

Journal
Array
Published
2024-12-01
DOI
https://doi.org/10.1016/j.array.2024.100371
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FLRF: Federated recommendation optimization for long-tail data distribution

Siyu Chen, Qiangsheng Dai, Zhexuan Gong, Ying Feng et al.
Array
Recommender Systems and Techniques
article

FLRF: Federated recommendation optimization for long-tail data distribution

Siyu Chen, Qiangsheng Dai, Zhexuan Gong, Ying Feng, Jinghui Zhang
article en

Abstract

Recommendation systems play a crucial role in real-world applications. Federated learning allows training recommendation systems without revealing users’ private data, thereby protecting user privacy. As a result, federated recommendation systems have gained increasing attention in recent years. However, The long-tail distribution problem of federated recommendation systems has not received enough attention. A small number of popular items receive most of the users’ attention, while a significantly larger number of less popular items receive feedback from only a small portion of users. Existing federated recommendation systems usually train on datasets with a long-tail distribution, which can easily lead to over fitting on a small number of popular items, reducing the diversity and novelty of recommendations and causing popularity bias. This paper proposes FLRF, a Federated Long-tail Recommendation Framework, which consists a long-tail recommendation model based on disentangled learning and a long-tail-aware aggregation method based on the attention mechanism. The long-tail recommendation model utilizes the idea of disentangled representation learning to explicitly disentangle the attractiveness of items into fame and niche. The long-tail-aware model aggregation, performs global attention aggregation on the model parameters of the fame part and self-attention aggregation on the model parameters of the niche part. We conduct comparative experiments on the three real-world datasets against the baseline methods in terms of accuracy and novelty. The experimental results show that the proposed framework can improve the diversity and novelty of recommendations without significantly impacting recommendation accuracy.

ArrayVol. 24
State Grid Corporation of China (China) (CN), Shanghai Electric (China) (CN), Southeast University (CN)
Openalex Percentile: Top 65%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.