Self-Monitoring Large Language Models for Click-Through Rate Prediction

Click-through rate prediction tasks estimate interaction probabilities using user–item features (i.e., the combined set of user and item features). LLMs have emerged as a promising approach by organizing these features into prompts and fine-tuning LLMs to predict the interaction label. However, our feature-wise and interaction-wise analysis reveals two critical limitations, leading to incomplete relationship modeling between user–item features and interaction labels: (i) LLMs tend to utilize only a subset of available features, neglecting others, and (ii) they struggle with predictions for tail items that appear less frequently in the training samples. To bridge this gap, we propose Feature-Instructed Large language model for Monitoring ( FILM ), which introduces a self-monitoring temperature mechanism that dynamically guides LLMs to focus on informative features, and an auxiliary compaction loss that facilitates better feature-interaction relationship learning for tail items. By integrating these two designs, FILM not only improves feature utilization in LLMs but also enhances predictions for tail items. Furthermore, we demonstrate that FILM -generated interaction embeddings can be transferred to lightweight models, enabling efficient deployment. Extensive experiments demonstrate that FILM achieves significant performance improvements over state-of-the-art baselines by learning better relationships between user–item features and interaction labels and generalizes under different LLM backbones.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Information Systems
Published
2025-08-26
DOI
https://doi.org/10.1145/3763789
Citations
1
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
3.25

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Self-Monitoring Large Language Models for Click-Through Rate Prediction

Anthony Kong, Huachi Zhou, Xiao Huang, Daochen Zha et al.
1 citations
ACM Transactions on Information Systems
Recommender Systems and Techniques
3.25
article

Self-Monitoring Large Language Models for Click-Through Rate Prediction

Anthony Kong, Huachi Zhou, Xiao Huang, Daochen Zha, Hao Chen, Qinggang Zhang, Kravtsova Viktoria Yu., Wenqi Pei
article en
1 citations

Abstract

Click-through rate prediction tasks estimate interaction probabilities using user–item features (i.e., the combined set of user and item features). LLMs have emerged as a promising approach by organizing these features into prompts and fine-tuning LLMs to predict the interaction label. However, our feature-wise and interaction-wise analysis reveals two critical limitations, leading to incomplete relationship modeling between user–item features and interaction labels: (i) LLMs tend to utilize only a subset of available features, neglecting others, and (ii) they struggle with predictions for tail items that appear less frequently in the training samples. To bridge this gap, we propose Feature-Instructed Large language model for Monitoring ( FILM ), which introduces a self-monitoring temperature mechanism that dynamically guides LLMs to focus on informative features, and an auxiliary compaction loss that facilitates better feature-interaction relationship learning for tail items. By integrating these two designs, FILM not only improves feature utilization in LLMs but also enhances predictions for tail items. Furthermore, we demonstrate that FILM -generated interaction embeddings can be transferred to lightweight models, enabling efficient deployment. Extensive experiments demonstrate that FILM achieves significant performance improvements over state-of-the-art baselines by learning better relationships between user–item features and interaction labels and generalizes under different LLM backbones.

ACM Transactions on Information SystemsVol. 44(1)
Hong Kong Polytechnic University (HK), National University of Singapore (SG), University of Macau (MO), Rice University (US)
Innovation and Technology Commission
Openalex Percentile: Top 7%
Recommender Systems and Techniques
3.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.