Unveiling the Potential of LLMs in Simulated Society: A Knowledge-Driven LLM Agent Framework for User Modeling

User modeling serves as the cornerstone of modern recommendation systems, focusing on the precise identification of user preferences and behavioral signatures to enable personalized service delivery. Existing recommendation methods face issues like sparse data and lack of transparency. The advent of large language models (LLMs) has brought new possibilities for inferring user preferences, which provides natural-language-based recommendation rationales and affective expressions. Motivated by AgentSociety Challenge @ WWW 2025 focused on simulating user-item interactions, we propose a knowledge-driven LLM agent framework for simulating user-item review interactions, which includes three modules: preference refinement, dual-signal injection, and category distinguisher. Specifically, preference refinement aims to model user and item profiles, enabling LLMs to perceive users and items comprehensively. Dual-signal Injection aims to incorporate external knowledge, such as collaborative filtering and distribution knowledge. Category distinguisher is designed to analyze the differences between true data and simulated data. Both online and offline experimental results demonstrate the effectiveness of this framework and prove the great potential of LLMs in user modeling.

Authors

Institutions

Publication Details

Published
2025-05-08
DOI
https://doi.org/10.1145/3701716.3719232
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unveiling the Potential of LLMs in Simulated Society: A Knowledge-Driven LLM Agent Framework for User Modeling

Bin Xie, Yinjin Li, Bingbing Xu, Huawei Shen et al.
Semantic Web and Ontologies
article

Unveiling the Potential of LLMs in Simulated Society: A Knowledge-Driven LLM Agent Framework for User Modeling

Bin Xie, Yinjin Li, Bingbing Xu, Huawei Shen, Yige Yuan, S. Zhu
article en

Abstract

User modeling serves as the cornerstone of modern recommendation systems, focusing on the precise identification of user preferences and behavioral signatures to enable personalized service delivery. Existing recommendation methods face issues like sparse data and lack of transparency. The advent of large language models (LLMs) has brought new possibilities for inferring user preferences, which provides natural-language-based recommendation rationales and affective expressions. Motivated by AgentSociety Challenge @ WWW 2025 focused on simulating user-item interactions, we propose a knowledge-driven LLM agent framework for simulating user-item review interactions, which includes three modules: preference refinement, dual-signal injection, and category distinguisher. Specifically, preference refinement aims to model user and item profiles, enabling LLMs to perceive users and items comprehensively. Dual-signal Injection aims to incorporate external knowledge, such as collaborative filtering and distribution knowledge. Category distinguisher is designed to analyze the differences between true data and simulated data. Both online and offline experimental results demonstrate the effectiveness of this framework and prove the great potential of LLMs in user modeling.

Chinese Academy of Sciences (CN), Institute of Computing Technology (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 95%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.