The Silent Saboteur: Imperceptible Adversarial Attacks against Black-Box Retrieval-Augmented Generation Systems

We explore adversarial attacks against retrievalaugmented generation (RAG) systems to identify their vulnerabilities.We focus on generating human-imperceptible adversarial examples and introduce a novel imperceptible retrieveto-generate attack against RAG.This task aims to find imperceptible perturbations that retrieve a target document, originally excluded from the initial top-k candidate set, in order to influence the final answer generation.To address this task, we propose ReGENT, a reinforcement learning-based framework that tracks interactions between the attacker and the target RAG and continuously refines attack strategies based on relevance-generation-naturalness rewards.Experiments on newly constructed factual and non-factual question-answering benchmarks demonstrate that ReGENT significantly outperforms existing attack methods in misleading RAG systems with small imperceptible text perturbations.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.717
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Silent Saboteur: Imperceptible Adversarial Attacks against Black-Box Retrieval-Augmented Generation Systems

Ruqing Zhang, Xueqi Cheng, Maarten de Rijke, Jianming Lv et al.
Adversarial Robustness in Machine Learning
article

The Silent Saboteur: Imperceptible Adversarial Attacks against Black-Box Retrieval-Augmented Generation Systems

Ruqing Zhang, Xueqi Cheng, Maarten de Rijke, Jianming Lv, Jiafeng Guo, Yuan Liu, Hongru Song
article en

Abstract

We explore adversarial attacks against retrievalaugmented generation (RAG) systems to identify their vulnerabilities.We focus on generating human-imperceptible adversarial examples and introduce a novel imperceptible retrieveto-generate attack against RAG.This task aims to find imperceptible perturbations that retrieve a target document, originally excluded from the initial top-k candidate set, in order to influence the final answer generation.To address this task, we propose ReGENT, a reinforcement learning-based framework that tracks interactions between the attacker and the target RAG and continuously refines attack strategies based on relevance-generation-naturalness rewards.Experiments on newly constructed factual and non-factual question-answering benchmarks demonstrate that ReGENT significantly outperforms existing attack methods in misleading RAG systems with small imperceptible text perturbations.

European Commission, National Natural Science Foundation of China, Nederlandse Organisatie voor Wetenschappelijk Onderzoek, HORIZON EUROPE Framework Programme, National Key Research and Development Program of China
Openalex Percentile: Top 90%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Silent Saboteur: Imperceptible Adversarial Attacks against Black-Box Retrieval-Augmented Generation Systems — Ruqing Zhang, Xueqi Cheng, et al. · (2025) | TGRS Research Map | TGRS