About Authenticity in Information Retrieval: A Keynote at ICTIR 2025

Retrieval-augmented generation (RAG) leverages LLMs to automatically find relevant documents and to provide users with direct answers to their queries. Supplying retrieved documents deemed to be relevant during answer generation reduces LLM "hallucinations." However, as generative AI proliferates, a RAG system will increasingly find documents that have been generated as well. Although they can be useful, we observe that LLMs favor generated over authentic content during retrieval. In our research, we have shown that detecting LLM-generated content proves to be inherently more difficult than expected. Likewise, citing a source for a generated statement makes it verifiable. But it often remains unclear which sources have been discarded in favor of the cited one. We demonstrate this kind of framing in the context of product search. Direct answers often narrow the user's perspective of the available diversity of choices. The sincerity of a RAG system must therefore be judged by the authenticity of its answers. Date: 18 July 2025.

Authors

Institutions

Publication Details

Journal
ACM SIGIR Forum
Published
2025-12-01
DOI
https://doi.org/10.1145/3799914.3799919
Primary Topic
Information Retrieval and Search Behavior
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

About Authenticity in Information Retrieval: A Keynote at ICTIR 2025

Martin Potthast
ACM SIGIR Forum
Information Retrieval and Search Behavior
article

About Authenticity in Information Retrieval: A Keynote at ICTIR 2025

Martin Potthast
article en

Abstract

Retrieval-augmented generation (RAG) leverages LLMs to automatically find relevant documents and to provide users with direct answers to their queries. Supplying retrieved documents deemed to be relevant during answer generation reduces LLM "hallucinations." However, as generative AI proliferates, a RAG system will increasingly find documents that have been generated as well. Although they can be useful, we observe that LLMs favor generated over authentic content during retrieval. In our research, we have shown that detecting LLM-generated content proves to be inherently more difficult than expected. Likewise, citing a source for a generated statement makes it verifiable. But it often remains unclear which sources have been discarded in favor of the cited one. We demonstrate this kind of framing in the context of product search. Direct answers often narrow the user's perspective of the available diversity of choices. The sincerity of a RAG system must therefore be judged by the authenticity of its answers. Date: 18 July 2025.

ACM SIGIR ForumVol. 59(2)
University of Kassel (DE)
Openalex Percentile: Top 13%
Information Retrieval and Search Behavior
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.