Enhancing the robustness of Fast-DetectGPT against paraphrase attacks
Large Language Models (LLMs) have been able to generate high-quality text and demonstrate excellent performance in various tasks. However, the ability of large language models to generate increasingly efficient human like texts has also raised concerns about their misuse for malicious purposes. Therefore, it is urgent to design a reliable and robust method for generating text detection. The zero-shot detector Fast-DetectGPT not only demonstrates strong performance in detection accuracy, but is also commendable in detection speed. However, it is unclear whether it can still maintain such a high detection success rate in the face of paraphrase attacks. In this article, we use various paraphrase attacks to perturb text and evaluate the robustness of Fast-DetectGPT, and find a significant decrease in its performance. Meanwhile, we propose Sentence-DetectGPT to optimize the detection process of Fast-DetectGPT, greatly enhancing its robustness in the face of paraphrase attacks.
Authors
- Suning Li (ORCID: https://orcid.org/0009-0005-0573-5756)
Institutions
- Beijing University of Posts and Telecommunications (CN)
Publication Details
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/cait64506.2024.10962860
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00