NExT-Search: Rebuilding User Feedback Ecosystem for Generative AI Search
Generative AI search driven by large language models (LLMs) is reshaping information retrieval by offering end-to-end answers to complex queries, reducing users' reliance on manually browsing and summarizing multiple web pages. However, while this paradigm enhances convenience, it disrupts the feedback-driven improvement loop that has historically powered the evolution of traditional Web search. Web search can continuously improve their ranking models by collecting large-scale, fine-grained user feedback (e.g., clicks, dwell time) at the document level. In contrast, generative AI search operates through a much longer search pipeline-spanning query decomposition, document retrieval, and answer generation-yet typically receives only coarse-grained feedback on the final answer. This introduces a feedback loop disconnect, where user feedback for the final output cannot be effectively mapped back to specific system components, making it difficult to improve each intermediate stage and sustain the feedback loop.
Authors
- Liang Pang (ORCID: https://orcid.org/0000-0003-1161-8546)
- Jun Xu (ORCID: https://orcid.org/0000-0001-7170-111X)
- Ji-Rong Wen (ORCID: https://orcid.org/0000-0002-9777-9676)
- Sunhao Dai (ORCID: https://orcid.org/0009-0002-7549-0860)
- Tat‐Seng Chua (ORCID: https://orcid.org/0000-0001-6097-7807)
- See-Kiong Ng (ORCID: https://orcid.org/0000-0001-6565-7511)
- Wenjie Wang (ORCID: https://orcid.org/0000-0002-5199-1428)
Institutions
- University of Science and Technology of China (CN)
- National University of Singapore (SG)
- Chinese Academy of Sciences (CN)
- Institute of Computing Technology (CN)
- Renmin University of China (CN)
Publication Details
- Published
- 2025-07-13
- DOI
- https://doi.org/10.1145/3726302.3730353
- Primary Topic
- Information Retrieval and Search Behavior
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Cisco Systems
- National Research Foundation
- National University of Singapore
- National Research Foundation Singapore
- National Natural Science Foundation of China
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
- Youth Innovation Promotion Association