Self-Monitoring Large Language Models for Click-Through Rate Prediction
Click-through rate prediction tasks estimate interaction probabilities using user–item features (i.e., the combined set of user and item features). LLMs have emerged as a promising approach by organizing these features into prompts and fine-tuning LLMs to predict the interaction label. However, our feature-wise and interaction-wise analysis reveals two critical limitations, leading to incomplete relationship modeling between user–item features and interaction labels: (i) LLMs tend to utilize only a subset of available features, neglecting others, and (ii) they struggle with predictions for tail items that appear less frequently in the training samples. To bridge this gap, we propose Feature-Instructed Large language model for Monitoring ( FILM ), which introduces a self-monitoring temperature mechanism that dynamically guides LLMs to focus on informative features, and an auxiliary compaction loss that facilitates better feature-interaction relationship learning for tail items. By integrating these two designs, FILM not only improves feature utilization in LLMs but also enhances predictions for tail items. Furthermore, we demonstrate that FILM -generated interaction embeddings can be transferred to lightweight models, enabling efficient deployment. Extensive experiments demonstrate that FILM achieves significant performance improvements over state-of-the-art baselines by learning better relationships between user–item features and interaction labels and generalizes under different LLM backbones.
Authors
- Anthony Kong (ORCID: https://orcid.org/0000-0002-8918-5616)
- Huachi Zhou (ORCID: https://orcid.org/0000-0002-8301-8470)
- Xiao Huang (ORCID: https://orcid.org/0000-0002-3867-900X)
- Daochen Zha (ORCID: https://orcid.org/0000-0002-6677-7504)
- Hao Chen (ORCID: https://orcid.org/0000-0001-6816-5344)
- Qinggang Zhang (ORCID: https://orcid.org/0000-0002-0247-4942)
- Kravtsova Viktoria Yu.
- Wenqi Pei
Institutions
- Hong Kong Polytechnic University (HK)
- National University of Singapore (SG)
- University of Macau (MO)
- Rice University (US)
Publication Details
- Journal
- ACM Transactions on Information Systems
- Published
- 2025-08-26
- DOI
- https://doi.org/10.1145/3763789
- Citations
- 1
- Primary Topic
- Recommender Systems and Techniques
- Type
- article
- Field-Weighted Citation Impact
- 3.25
Funders
- Innovation and Technology Commission