Combine Pre-Trained Language Model and Classical Recommendation Network for Conversational Recommender Systems

Conversational recommender systems (CRSs) typically require natural language interaction with users and complete recommendations within the conversation. Existing approaches often struggle with the integration of generated responses and recommended items. To address this, we propose a novel CRS model named KGPLM, incorporating the Knowledge Graph based recommender module and the dialogue module based on the fine-tuned Pre-trained Language Model (PLM). We decompose the dialogue generation task into two subtasks: dialogue goal prediction and response generation. The former enables the system to make recommendations appropriately during the conversation, while the latter, through the introduction of item tokens, achieves the seamless integration between the recommended items and the generated responses. To fine-tune PLM for the CRS, we propose a two-stage fine-tuning approach: (1) multi-task learning explores the connections between the two sub-tasks; (2) prompt learning optimizes the model's performance on specific sub-tasks. Experimental results demonstrate the effectiveness of our approach on both item recommendation and response generation tasks in the final responses.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/iccc62609.2024.10941746
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Combine Pre-Trained Language Model and Classical Recommendation Network for Conversational Recommender Systems

Haofan Huang, Yuehai Wang, Xi Chen, Yan Zhang et al.
Topic Modeling
article

Combine Pre-Trained Language Model and Classical Recommendation Network for Conversational Recommender Systems

Haofan Huang, Yuehai Wang, Xi Chen, Yan Zhang, Yinlin Guo, Yening Lv
article en

Abstract

Conversational recommender systems (CRSs) typically require natural language interaction with users and complete recommendations within the conversation. Existing approaches often struggle with the integration of generated responses and recommended items. To address this, we propose a novel CRS model named KGPLM, incorporating the Knowledge Graph based recommender module and the dialogue module based on the fine-tuned Pre-trained Language Model (PLM). We decompose the dialogue generation task into two subtasks: dialogue goal prediction and response generation. The former enables the system to make recommendations appropriately during the conversation, while the latter, through the introduction of item tokens, achieves the seamless integration between the recommended items and the generated responses. To fine-tune PLM for the CRS, we propose a two-stage fine-tuning approach: (1) multi-task learning explores the connections between the two sub-tasks; (2) prompt learning optimizes the model's performance on specific sub-tasks. Experimental results demonstrate the effectiveness of our approach on both item recommendation and response generation tasks in the final responses.

Zhejiang University (CN)
Quality Education
Openalex Percentile: Top 74%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Combine Pre-Trained Language Model and Classical Recommendation Network for Conversational Recommender Systems — Haofan Huang, Yuehai Wang, et al. · (2024) | TGRS Research Map | TGRS