A Survey on Audio-Driven Talking Face Generation

In recent years, advancements in deep learning have driven the development of audio-driven talking face generation. This technology has widespread applications in virtual avatars, intelligent assistants, film and television special effects, remote education, digital human live streaming, and more. Audio-driven talking face generation methods synthesize synchronized talking videos based on input speech signals, ensuring that the mouth movements, facial expressions, and head poses of virtual characters naturally align with the speech content. This paper provides an overview of the major research progress in this field and analyzes the advantages and limitations of different techniques. Additionally, it introduces evaluation metrics used to assess model performance in detail. Finally, the paper summarizes current challenges and potential future research directions.

Authors

Institutions

Publication Details

Published
2025-04-11
DOI
https://doi.org/10.1109/ainit65432.2025.11035674
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Survey on Audio-Driven Talking Face Generation

Tingting Du, Xiangzhen He, Wenhao Jiang, Xue Bai et al.
Speech and Audio Processing
article

A Survey on Audio-Driven Talking Face Generation

Tingting Du, Xiangzhen He, Wenhao Jiang, Xue Bai, Zijian Huang, Mengdi Ma, Xiang Wang
article en

Abstract

In recent years, advancements in deep learning have driven the development of audio-driven talking face generation. This technology has widespread applications in virtual avatars, intelligent assistants, film and television special effects, remote education, digital human live streaming, and more. Audio-driven talking face generation methods synthesize synchronized talking videos based on input speech signals, ensuring that the mouth movements, facial expressions, and head poses of virtual characters naturally align with the speech content. This paper provides an overview of the major research progress in this field and analyzes the advantages and limitations of different techniques. Additionally, it introduces evaluation metrics used to assess model performance in detail. Finally, the paper summarizes current challenges and potential future research directions.

Minzu University of China (CN)
National Natural Science Foundation of China, Northwest Minzu University
Openalex Percentile: Top 83%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.