BLIP-Adapter: Bridging Vision-Language Models with Adapters for Generalizable Face Anti-spoofing

Face anti-spoofing is essential for ensuring the security of facial recognition systems against spoofing attacks. Recent methods have transferred Vision-Language models to face anti-spoofing (e.g., FLIP and CLIPC8), demonstrating that learning perception from supervision in natural language can enhance the model’s detection performance. However, such methods exhibit limited depth in the interaction between images and texts, resulting in poor performance on fine-grained understanding tasks such as face anti-spoofing. Besides, the lack of diversity in image-text pairs for face anti-spoofing further hinders such methods from playing their best. To address these issues, we propose a novel fine-tuning strategy for Vision-Language models in face anti-spoofing. This strategy introduces the Bootstrapping Language-Image Pre-training model (BLIP), known for its novel interaction mechanisms and superior image-text comprehension, to construct a more generalized feature representation for face anti-spoofing. Furthermore, we propose an Adapter module for the text branch to reduce the negative impact of insufficient data diversity and catastrophic forgetting. Extensive experiments conducted on various cross-domain testing benchmarks demonstrate the significant superiority of our method over the state-of-the-art, highlighting its effectiveness and robustness.