A Survey on Audio-Driven Talking Face Generation
In recent years, advancements in deep learning have driven the development of audio-driven talking face generation. This technology has widespread applications in virtual avatars, intelligent assistants, film and television special effects, remote education, digital human live streaming, and more. Audio-driven talking face generation methods synthesize synchronized talking videos based on input speech signals, ensuring that the mouth movements, facial expressions, and head poses of virtual characters naturally align with the speech content. This paper provides an overview of the major research progress in this field and analyzes the advantages and limitations of different techniques. Additionally, it introduces evaluation metrics used to assess model performance in detail. Finally, the paper summarizes current challenges and potential future research directions.
Authors
- Tingting Du (ORCID: https://orcid.org/0000-0001-7389-0743)
- Xiangzhen He
- Wenhao Jiang
- Xue Bai (ORCID: https://orcid.org/0000-0001-9283-3015)
- Zijian Huang (ORCID: https://orcid.org/0000-0001-8316-4753)
- Mengdi Ma
- Xiang Wang (ORCID: https://orcid.org/0000-0002-0320-7790)
Institutions
- Minzu University of China (CN)
Publication Details
- Published
- 2025-04-11
- DOI
- https://doi.org/10.1109/ainit65432.2025.11035674
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Northwest Minzu University