Protective Perturbations Against Unauthorized Data Usage in Diffusion-Based Image Generation

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and intellectual property issues. Existing methods introduce protective perturbations based on adversarial attacks, which are applied to the customization samples. In this systematization of knowledge, we present a comprehensive survey of protective perturbation methods designed to prevent unauthorized data usage in diffusion-based image generation. We establish the threat model and categorize the downstream tasks relevant to these methods, providing a detailed analysis of their designs. We also propose a completed evaluation framework for these perturbation techniques, aiming to advance research in this field.

Authors

Institutions

Publication Details

Published
2024-11-28
DOI
https://doi.org/10.1109/cbd65573.2024.00031
Primary Topic
Computer Graphics and Visualization Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Protective Perturbations Against Unauthorized Data Usage in Diffusion-Based Image Generation

Xiaohua Jia, Sen Peng, J. He., Jijia Yang et al.
Computer Graphics and Visualization Techniques
article

Protective Perturbations Against Unauthorized Data Usage in Diffusion-Based Image Generation

Xiaohua Jia, Sen Peng, J. He., Jijia Yang, Mingyue Wang
article en

Abstract

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and intellectual property issues. Existing methods introduce protective perturbations based on adversarial attacks, which are applied to the customization samples. In this systematization of knowledge, we present a comprehensive survey of protective perturbation methods designed to prevent unauthorized data usage in diffusion-based image generation. We establish the threat model and categorize the downstream tasks relevant to these methods, providing a detailed analysis of their designs. We also propose a completed evaluation framework for these perturbation techniques, aiming to advance research in this field.

City University of Hong Kong (HK)
Openalex Percentile: Top 48%
Computer Graphics and Visualization Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Protective Perturbations Against Unauthorized Data Usage in Diffusion-Based Image Generation — Xiaohua Jia, Sen Peng, et al. · (2024) | TGRS Research Map | TGRS