LADIMO: Face Morph Generation through Biometric Template Inversion with Latent Diffusion

Face morphing attacks pose a severe security threat to face recognition systems, enabling the morphed face image to be verified against multiple identities. To detect such manipulated images, the development of new face morphing methods becomes essential to increase the diversity of training datasets used for face morph detection. In this study, we present a representation-level face morphing approach, namely LADIMO, that performs morphing on two face recognition embeddings. Specifically, we train a Latent Diffusion Model to invert a biometric template - thus reconstructing the face image from an FRS latent representation. Our subsequent vulnerability analysis demonstrates the high morph attack potential in comparison to MIPGAN-II, an established GAN-based face morphing approach. Finally, we exploit the stochastic LADMIO model design in combination with our identity conditioning mechanism to create unlimited morphing attacks from a single face morph image pair. We show that each face morph variant has an individual attack success rate, enabling us to maximize the morph attack potential by applying a simple re-sampling strategy. We will publish our code and pre-trained models upon the acceptance of this paper.

Authors

Institutions

Publication Details

Published
2024-09-15
DOI
https://doi.org/10.1109/ijcb62174.2024.10744444
Citations
6
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
1.50

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LADIMO: Face Morph Generation through Biometric Template Inversion with Latent Diffusion

Christoph Busch, Marcel Grimmer
6 citations
Face recognition and analysis
1.50
article

LADIMO: Face Morph Generation through Biometric Template Inversion with Latent Diffusion

Christoph Busch, Marcel Grimmer
article en
6 citations

Abstract

Face morphing attacks pose a severe security threat to face recognition systems, enabling the morphed face image to be verified against multiple identities. To detect such manipulated images, the development of new face morphing methods becomes essential to increase the diversity of training datasets used for face morph detection. In this study, we present a representation-level face morphing approach, namely LADIMO, that performs morphing on two face recognition embeddings. Specifically, we train a Latent Diffusion Model to invert a biometric template - thus reconstructing the face image from an FRS latent representation. Our subsequent vulnerability analysis demonstrates the high morph attack potential in comparison to MIPGAN-II, an established GAN-based face morphing approach. Finally, we exploit the stochastic LADMIO model design in combination with our identity conditioning mechanism to create unlimited morphing attacks from a single face morph image pair. We show that each face morph variant has an individual attack success rate, enabling us to maximize the morph attack potential by applying a simple re-sampling strategy. We will publish our code and pre-trained models upon the acceptance of this paper.

Norwegian University of Science and Technology (NO)
Ministry of Education
Climate action
Openalex Percentile: Top 16%
Face recognition and analysis
1.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

LADIMO: Face Morph Generation through Biometric Template Inversion with Latent Diffusion — Christoph Busch, Marcel Grimmer · (2024) | TGRS Research Map | TGRS