C-SOUL: A Principled Framework for Preference Expansion via Causal Deconfounding and Offline Reinforcement Learning
C-SOUL (Causal System for Open-ended User Learning) is a recommendation framework that replaces engagement optimisation with a mathematically grounded objective: measurable user growth. It combines causal deconfounding via Inverse Propensity Scoring, probabilistic user state modelling via a β-VAE with LSTM backbone, and offline reinforcement learning via a Counterfactual Decision Transformer. A novel Flourishing Reward function directly penalises preference stagnation, incentivising the system to expand user taste horizons through content they actually enjoy. Policy superiority is verified pre-deployment using a Doubly Robust estimator. Prototyped on a synthetic dataset mimicking KuaiRec's structure, achieving a DR policy value of 6.071 and 55.1% effective sample size fraction.
Authors
- Muhammad Talha (ORCID: https://orcid.org/0000-0003-2365-6232)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-07-24
- DOI
- https://doi.org/10.5281/zenodo.21527160
- Primary Topic
- Recommender Systems and Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00