NER: Nash Entropy-Regularised Scoring for Diversity-Aware Collaborative Filtering
NBS has a structural popularity bias: popular items, by virtue of their high average rating d_i, produce larger item surplus (r̂_ui − d_i) for any well-matched user, systematically dominating top-K lists. The paper proves this formally in Lemma 1 and then argues that the correct remedy is not to penalise popularity per se but to reward audience diversity — items whose rating mass is spread across heterogeneous users represent broader, more robust relevance. H_i = −Σ p_{u'i} log p_{u'i} (Shannon entropy of item i's rating distribution)NER(u,i;γ) = MinMax(NBS(u,i)) + γ · MinMax(H_i) The additive (not multiplicative) entropy bonus ensures that high-entropy items with low NBS can still rise — a deliberate design choice. Proposition 1 proves a smooth redistribution law: items with above-average entropy gain recommendation frequency linearly in γ at the expense of below-average items. Theorem 2 proves the non-monotone NDCG optimum — there exists a γ* > 0 strictly interior, because beyond it the entropy signal overwhelms the relevance signal. The theorem condition (Corr(H_i, r̂_{u*i}) > 0) is satisfied on dense datasets where diverse items accumulate sufficient training signal, correctly predicting γ* = 0.3 on ML-100K. NER is the strongest Nash variant on accuracy: P@10 = 0.0827 and NDCG@10 = 0.0369 on ML-100K, a 5.6× improvement over symmetric NBS in Precision.
Authors
- Assil KHELIFI
Institutions
- United States Postal Service (US)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-03-21
- DOI
- https://doi.org/10.5281/zenodo.19154440
- Primary Topic
- Recommender Systems and Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00