The Competition of Fairness in AI-generated Face Detection: Methods and Results

Abstract AI-generated facial synthesis (DeepFakes) has rapidly progressed through advanced generative models, producing realistic manipulated media that is increasingly difficult to distinguish from authentic content. Misuse of these technologies threatens public trust and democratic stability, particularly in sensitive contexts. Beyond detection accuracy, responsible forensic analysis demands fair and ethical deployment, yet recent studies reveal demographic performance disparities that existing methods have not adequately addressed, and fairness approaches often fail to generalize under distribution shifts. To address this issue, we organized the first competition focused on fairness in AI-generated face detection at NeurIPS 2025, connecting fairness research with real-world DeepFake challenges. The competition attracted substantial global participation, including more than 64 registered teams and 158 participants from 63 organizations across 20 countries, with 11 teams surpassing the baseline. Analysis of the submitted methods reveals that the most effective approaches combined data-centric design, robust representation learning, and model-level diversification rather than relying on fairness constraints alone. In particular, the top-ranked solution achieved strong fairness improvements by integrating careful data curation, a mixture-of-experts architecture, and test-time augmentation, demonstrating that fairness generalization can be improved without explicitly optimizing demographic-specific losses. Other competitive methods explored complementary directions, including foundation-model-based feature extraction, dual-branch fusion of global and local cues, ensemble learning, and post hoc calibration, each exposing distinct trade-offs among fairness, utility, and deployability. Our findings highlight that fairness metrics can be significantly improved through strategic system design, but also reveal limitations of current evaluation protocols and the risk of trivial solutions under fixed thresholds. Overall, this competition provides concrete empirical evidence and methodological insights for building more fair, robust, and trustworthy DeepFake detection systems, and offers guidance for future benchmarks, evaluation metrics, and responsible deployment practices. The competition website is available at: https://sites.google.com/view/aifacedetection/ .

Authors

Institutions

Publication Details

Journal
Machine Intelligence Research
Published
2026-04-13
DOI
https://doi.org/10.1007/s11633-026-1637-x
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Competition of Fairness in AI-generated Face Detection: Methods and Results

Olivier Koch, Simon Bozonnet, Jochem Gietema, Arthur Pajot et al.
Machine Intelligence Research
Face recognition and analysis
article

The Competition of Fairness in AI-generated Face Detection: Methods and Results

Olivier Koch, Simon Bozonnet, Jochem Gietema, Arthur Pajot, Ryan Ofman, Shail Desai, Martins Bruveris, Zonghui Guo, Cristian Canton, Anne-Flore Baron, Junseok Kwon, Guisik Kim, Fang‐Yi Su, Xingming Long, Luisa Verdoliva, Zara Alaverdyan, Romain Sabathe, Leyang Huang, Xiaoming Liu, Jinhee Park, Shu Hu, A. Park, Sachi Nandan Mohanty, Fengming Gu, Jon Gillham, Lucia Innocenti, Li Lin, Wenqing Ge, Yongwei Tang, Jiawen Seow, Ting-Wan Kao, Taewoo Kim, Narcis Bejtic, Daniel S. Schiff, Shiguang Shan, Sebastian Balmuş, Yingjie Liu, Tsung-Hua Lee, Zhaoda Li, Mengyun Tang, Xin Wang, Minjun Kim, Guangyu Lin, YoungJoon Yoo, Bogdan Dura, Aditya Pawar, Yuecong Min, Jie Zhang, Xiangkui Cao, Wenbin Zhang, Baoyuan Wu, Harry Ni, Zhiqiang Wu, Lisa Ivanova, Siwei Lyu
article en

Abstract

Abstract AI-generated facial synthesis (DeepFakes) has rapidly progressed through advanced generative models, producing realistic manipulated media that is increasingly difficult to distinguish from authentic content. Misuse of these technologies threatens public trust and democratic stability, particularly in sensitive contexts. Beyond detection accuracy, responsible forensic analysis demands fair and ethical deployment, yet recent studies reveal demographic performance disparities that existing methods have not adequately addressed, and fairness approaches often fail to generalize under distribution shifts. To address this issue, we organized the first competition focused on fairness in AI-generated face detection at NeurIPS 2025, connecting fairness research with real-world DeepFake challenges. The competition attracted substantial global participation, including more than 64 registered teams and 158 participants from 63 organizations across 20 countries, with 11 teams surpassing the baseline. Analysis of the submitted methods reveals that the most effective approaches combined data-centric design, robust representation learning, and model-level diversification rather than relying on fairness constraints alone. In particular, the top-ranked solution achieved strong fairness improvements by integrating careful data curation, a mixture-of-experts architecture, and test-time augmentation, demonstrating that fairness generalization can be improved without explicitly optimizing demographic-specific losses. Other competitive methods explored complementary directions, including foundation-model-based feature extraction, dual-branch fusion of global and local cues, ensemble learning, and post hoc calibration, each exposing distinct trade-offs among fairness, utility, and deployability. Our findings highlight that fairness metrics can be significantly improved through strategic system design, but also reveal limitations of current evaluation protocols and the risk of trivial solutions under fixed thresholds. Overall, this competition provides concrete empirical evidence and methodological insights for building more fair, robust, and trustworthy DeepFake detection systems, and offers guidance for future benchmarks, evaluation metrics, and responsible deployment practices. The competition website is available at: https://sites.google.com/view/aifacedetection/ .

Machine Intelligence Research
Albany State University (US), University of North Carolina at Chapel Hill (US), Shanghai International Studies University (CN), Michigan Technological University (US), Entrust (GB), Harvard University (US), Chinese University of Hong Kong (HK), Purdue University West Lafayette (US), Barcelona Supercomputing Center (ES), University at Albany, State University of New York (US), Shanghai International Medical Center (CN), Institute of Computing Technology (CN), National Institute for Research and Development in Informatics - ICI Bucharest (RO), Chinese University of Hong Kong, Shenzhen (CN), Entrust Datacard (United States) (US), SRM University (IN), Doug Bragg Enterprises (Canada) (CA), Korea Electronics Technology Institute (KR), Youth Radio (United States) (US), Ocean University of China (CN), University at Buffalo, State University of New York (US), Chung-Ang University (KR), University of Naples Federico II (IT), Communication University of China (CN), University of Hong Kong (HK), Universitat Politècnica de Catalunya (ES)
National Science Foundation
Peace, Justice and strong institutions
Openalex Percentile: Top 26%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.