GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis
Amid the burgeoning development of generative models like diffusion models, the task of differentiating synthesized audio from its natural counterpart grows more daunting. Deepfake detection offers a viable solution to combat this challenge. Yet, this defensive measure unintentionally fuels the continued refinement of generative models. Watermarking emerges as a proactive and sustainable tactic, preemptively regulating the creation and dissemination of synthesized content. Thus, this paper, as a pioneer, proposes the <u>g</u>enerative <u>ro</u>bust audi<u>o</u>wa<u>t</u>ermarking method (Groot), presenting a paradigm for proactively supervising the synthesized audio and its source diffusion models. In this paradigm, the processes of watermark generation and audio synthesis occur simultaneously, facilitated by parameter-fixed diffusion models equipped with a dedicated encoder. The watermark embedded within the audio can subsequently be retrieved by a lightweight decoder. The experimental results highlight Groot's outstanding performance, particularly in terms of robustness, surpassing that of the leading state-of-the-art methods. Beyond its impressive resilience against individual post-processing attacks, Groot exhibits exceptional robustness when facing compound attacks, maintaining an average watermark extraction accuracy of around 95%. Our audio samples are available at https://groot-gaw.github.io/.
Authors
- Haizhou Li
- Dongdong Lin (ORCID: https://orcid.org/0009-0006-4376-3210)
- Yue Li (ORCID: https://orcid.org/0000-0001-6425-9298)
- Weizhi Liu
- Hui Tian (ORCID: https://orcid.org/0000-0002-1591-656X)
Institutions
- Huaqiao University (CN)
- Shenzhen University (CN)
- Chinese University of Hong Kong, Shenzhen (CN)
Publication Details
- Published
- 2024-10-26
- DOI
- https://doi.org/10.1145/3664647.3680596
- Citations
- 6
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 2.10