SDProtoL: Enhancing Rehearsal-Free Lifelong Face Forgery Detection via Prototype-Guided Prompt Tuning

The performance of deep neural networks in Face Forgery Detection (FFD) is impressive, but they are obtained with static models incapable of adapting their behavior over time. However, in a dynamic world, FFD systems deployed on Internet of Things (IoT) devices operate on vast streams of face data with ever-changing distributions, leading to catastrophic forgetting and significant declines in detection performance. To address this issue, we propose a novel Rehearsal-Free Domain Lifelong Learning (RF-DLL) framework for FFD, termed SDProtoL. This framework adopts the prompt-based incremental learning paradigm and steers prototypes to further mitigate catastrophic forgetting and improve generalization to unseen data. Specifically, to alleviate the forgetting of previous domains without using previous data, we employ a Gaussian Mixture Model (GMM) to derive GMM-based Hierarchical Static Prototypes (GHSP) with non-convex and anisotropic characteristics, in order to fit the complex distribution of face forgery data. Furthermore, for better generalization, we propose the Dynamic Prototype-oriented Asymmetric Contrastive Regularization (DPACR), which improves generalization ability for unseen data by accumulating and transferring previous knowledge. Simulating practical RF-DLL scenarios, we establish a challenging Lifelong Face Forgery Detection (LFFD) benchmark and construct three protocols referencing real-world scenarios. Extensive experimental results demonstrate that our proposed method significantly alleviates catastrophic forgetting while exhibiting superior generalization performance in unseen domains.

Authors

Institutions

Publication Details

Journal
IEEE Internet of Things Journal
Published
2025-05-28
DOI
https://doi.org/10.1109/jiot.2025.3574453
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SDProtoL: Enhancing Rehearsal-Free Lifelong Face Forgery Detection via Prototype-Guided Prompt Tuning

Hongxia Wang, Rui Zhang, Qiang Zeng, Yang Zhou et al.
IEEE Internet of Things Journal
Face recognition and analysis
article

SDProtoL: Enhancing Rehearsal-Free Lifelong Face Forgery Detection via Prototype-Guided Prompt Tuning

Hongxia Wang, Rui Zhang, Qiang Zeng, Yang Zhou, Hanqing Liu
article en

Abstract

The performance of deep neural networks in Face Forgery Detection (FFD) is impressive, but they are obtained with static models incapable of adapting their behavior over time. However, in a dynamic world, FFD systems deployed on Internet of Things (IoT) devices operate on vast streams of face data with ever-changing distributions, leading to catastrophic forgetting and significant declines in detection performance. To address this issue, we propose a novel Rehearsal-Free Domain Lifelong Learning (RF-DLL) framework for FFD, termed SDProtoL. This framework adopts the prompt-based incremental learning paradigm and steers prototypes to further mitigate catastrophic forgetting and improve generalization to unseen data. Specifically, to alleviate the forgetting of previous domains without using previous data, we employ a Gaussian Mixture Model (GMM) to derive GMM-based Hierarchical Static Prototypes (GHSP) with non-convex and anisotropic characteristics, in order to fit the complex distribution of face forgery data. Furthermore, for better generalization, we propose the Dynamic Prototype-oriented Asymmetric Contrastive Regularization (DPACR), which improves generalization ability for unseen data by accumulating and transferring previous knowledge. Simulating practical RF-DLL scenarios, we establish a challenging Lifelong Face Forgery Detection (LFFD) benchmark and construct three protocols referencing real-world scenarios. Extensive experimental results demonstrate that our proposed method significantly alleviates catastrophic forgetting while exhibiting superior generalization performance in unseen domains.

IEEE Internet of Things JournalVol. 12(15)
Sichuan University (CN)
National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 90%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

SDProtoL: Enhancing Rehearsal-Free Lifelong Face Forgery Detection via Prototype-Guided Prompt Tuning — Hongxia Wang, Rui Zhang, et al. · IEEE Internet of Things Journal (2025) | TGRS Research Map | TGRS