Segue: Side-information Guided Generative Unlearnable Examples for Facial Privacy Protection in Real World
The widespread adoption of face recognition has raised privacy concerns regarding the collection and use of facial data. To address this, researchers have explored "unlearnable examples" by adding imperceptible perturbations during model training to prevent the model from learning target features. However, current methods are inefficient and cannot guarantee transferability and robustness at the same time, causing impracticality in the real world. To remedy it, we introduce Side-information Guided Generative Unlearnable Examples (Segue). Using a once-trained multiple-used model to generate perturbations, Segue avoids the time-consuming gradient-based approach. To improve transferability, we introduce side information such as true or pseudo labels, which are inherently consistent across different scenarios. For robustness enhancement, a distortion layer is integrated into the training pipeline. Experiments show Segue is 1000× faster than previous methods, transferable across datasets and models, and resistant to JPEG compression, adversarial training, and standard augmentations.
Authors
- Zhiling Zhang (ORCID: https://orcid.org/0000-0001-7807-2264)
- Daiheng Gao (ORCID: https://orcid.org/0000-0002-2659-1414)
- Qinglang Guo (ORCID: https://orcid.org/0009-0006-8284-5139)
- Nenghai Yu (ORCID: https://orcid.org/0000-0003-4417-9316)
- Weiming Zhang (ORCID: https://orcid.org/0000-0002-3782-2855)
- Kui Zhang (ORCID: https://orcid.org/0000-0002-5634-9952)
- Jie Zhang (ORCID: https://orcid.org/0000-0002-9745-664X)
- Ting Xu (ORCID: https://orcid.org/0000-0002-5316-7213)
- Wenbo Zhou (ORCID: https://orcid.org/0000-0002-4703-4641)
- Zixian Guo
Institutions
- Agency for Science, Technology and Research (SG)
- University of Science and Technology of China (CN)
- National University of Singapore (SG)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10889952
- Primary Topic
- Face recognition and analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00