An Efficient and Flexible Black-Box Watermarking Framework for Large Language Models
To prevent misuse of text generated by large language models (LLMs), watermarking technology offers a straightforward and effective means of verification. Existing approaches, however, suffer from several limitations, including a high dependency on the underlying logic of LLMs, inadequate performance against sophisticated watermarking attacks, and poor stealth, making them less suitable for complex and dynamic real-world applications. To address these challenges, we propose an efficient and flexible black-box watermarking framework for large language models. This framework enhances robustness and stealth by embedding watermarks in key areas of the text through the identification and sampling of high-entropy words. Furthermore, we introduce an encryption-based encoding algorithm that allows users to verify watermarks with their personal keys, supporting the customization of watermarking algorithms. Comparative experiments on four datasets with five baseline methods demonstrate that the proposed method excels in accuracy while significantly improving robustness and concealability with minimal semantic changes.
Authors
- Zhongzhi Li (ORCID: https://orcid.org/0000-0002-6637-7033)
- Jiazhong Lu (ORCID: https://orcid.org/0000-0002-8982-8255)
- Xi Xiong (ORCID: https://orcid.org/0000-0002-3123-4200)
- Shiying Li (ORCID: https://orcid.org/0000-0001-8346-8757)
- Yu Yan (ORCID: https://orcid.org/0000-0003-2076-7172)
Institutions
- Chengdu University of Information Technology (CN)
Publication Details
- Published
- 2024-12-27
- DOI
- https://doi.org/10.1109/icctit64404.2024.10928654
- Primary Topic
- Advanced Steganography and Watermarking Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00