An Efficient and Flexible Black-Box Watermarking Framework for Large Language Models

To prevent misuse of text generated by large language models (LLMs), watermarking technology offers a straightforward and effective means of verification. Existing approaches, however, suffer from several limitations, including a high dependency on the underlying logic of LLMs, inadequate performance against sophisticated watermarking attacks, and poor stealth, making them less suitable for complex and dynamic real-world applications. To address these challenges, we propose an efficient and flexible black-box watermarking framework for large language models. This framework enhances robustness and stealth by embedding watermarks in key areas of the text through the identification and sampling of high-entropy words. Furthermore, we introduce an encryption-based encoding algorithm that allows users to verify watermarks with their personal keys, supporting the customization of watermarking algorithms. Comparative experiments on four datasets with five baseline methods demonstrate that the proposed method excels in accuracy while significantly improving robustness and concealability with minimal semantic changes.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icctit64404.2024.10928654
Primary Topic
Advanced Steganography and Watermarking Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Efficient and Flexible Black-Box Watermarking Framework for Large Language Models

Zhongzhi Li, Jiazhong Lu, Xi Xiong, Shiying Li et al.
Advanced Steganography and Watermarking Techniques
article

An Efficient and Flexible Black-Box Watermarking Framework for Large Language Models

Zhongzhi Li, Jiazhong Lu, Xi Xiong, Shiying Li, Yu Yan
article en

Abstract

To prevent misuse of text generated by large language models (LLMs), watermarking technology offers a straightforward and effective means of verification. Existing approaches, however, suffer from several limitations, including a high dependency on the underlying logic of LLMs, inadequate performance against sophisticated watermarking attacks, and poor stealth, making them less suitable for complex and dynamic real-world applications. To address these challenges, we propose an efficient and flexible black-box watermarking framework for large language models. This framework enhances robustness and stealth by embedding watermarks in key areas of the text through the identification and sampling of high-entropy words. Furthermore, we introduce an encryption-based encoding algorithm that allows users to verify watermarks with their personal keys, supporting the customization of watermarking algorithms. Comparative experiments on four datasets with five baseline methods demonstrate that the proposed method excels in accuracy while significantly improving robustness and concealability with minimal semantic changes.

Chengdu University of Information Technology (CN)
Openalex Percentile: Top 71%
Advanced Steganography and Watermarking Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.