Thqa: A Perceptual Quality Assessment Database for Talking Heads

In the realm of media technology, digital humans have gained prominence due to rapid advancements in computer technology. However, the manual modeling and control required for the majority of digital humans pose significant obstacles to efficient development. The speech-driven methods offer a novel avenue for manipulating the mouth shape and expressions of digital humans. Despite the proliferation of driving methods, the quality of many generated talking head (TH) videos remains a concern, impacting user visual experiences. To tackle this issue, this paper introduces the Talking Head Quality Assessment (THQA) database, featuring 800 TH videos generated through 8 diverse speechdriven methods. Extensive experiments affirm the THQA database’s richness in character and speech features. Subsequent subjective quality assessment experiments analyze correlations between scoring results and speech-driven methods, ages, and genders. In addition, experimental results show that mainstream image and video quality assessment methods have limitations for the THQA database, underscoring the imperative for further research to enhance TH video quality assessment. The THQA database is publicly accessible at https://github.com/zyj-2000/THQA.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/icip51287.2024.10647507
Citations
16
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
3.99

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Thqa: A Perceptual Quality Assessment Database for Talking Heads

Yingjie Zhou, Xiongkuo Min, Xiaohong Liu, Guangtao Zhai et al.
16 citations
Video Surveillance and Tracking Methods
3.99
article

Thqa: A Perceptual Quality Assessment Database for Talking Heads

Yingjie Zhou, Xiongkuo Min, Xiaohong Liu, Guangtao Zhai, Zhihua Wang, Xiao–Ping Zhang, Wei Sun, Zicheng Zhang
article en
16 citations

Abstract

In the realm of media technology, digital humans have gained prominence due to rapid advancements in computer technology. However, the manual modeling and control required for the majority of digital humans pose significant obstacles to efficient development. The speech-driven methods offer a novel avenue for manipulating the mouth shape and expressions of digital humans. Despite the proliferation of driving methods, the quality of many generated talking head (TH) videos remains a concern, impacting user visual experiences. To tackle this issue, this paper introduces the Talking Head Quality Assessment (THQA) database, featuring 800 TH videos generated through 8 diverse speechdriven methods. Extensive experiments affirm the THQA database’s richness in character and speech features. Subsequent subjective quality assessment experiments analyze correlations between scoring results and speech-driven methods, ages, and genders. In addition, experimental results show that mainstream image and video quality assessment methods have limitations for the THQA database, underscoring the imperative for further research to enhance TH video quality assessment. The THQA database is publicly accessible at https://github.com/zyj-2000/THQA.

Shenzhen University (CN), Shanghai Jiao Tong University (CN), Tsinghua–Berkeley Shenzhen Institute (CN), Shenzhen MSU-BIT University, Tsinghua University (CN)
National Natural Science Foundation of China, China Postdoctoral Science Foundation, Tsinghua Shenzhen International Graduate School
Openalex Percentile: Top 5%
Video Surveillance and Tracking Methods
3.99
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.