Animation Character Mouth Matching Model Considering Reinforcement Learning and Feature Extraction

With the development of the times, animation production has become increasingly sophisticated, and mouth matching is one of the key points to ensure the vividness and realism of animated characters. Therefore, a study proposes an animated character mouth matching model that takes into account reinforcement learning and feature extraction. Using the Actor-Critic method in reinforcement learning, the extracted audio and facial features are used as input states to predict the next facial feature in the next time step. The experimental results show that the proposed model has an average accuracy of 95.61% and an F1 value of 97.13% on three databases. Meanwhile, the peak signal-to-noise ratio and structural similarity index are 41.77 and 0.93, respectively, which are better than their comparison methods. In addition, the study tested the error of mouth shape under different emotions, and the results showed an average mean square error of only 6.639. Finally, the user survey results showed that the animated characters generated by the proposed model received more recognition in mouth shape matching and realism, with a highest selection rate of 98.64%. The successful application of the proposed model provides new ideas and methods for research in related fields, laying the foundation for further promotion and innovation of animation production technology.

Authors

Publication Details

Journal
Informatica
Published
2024-09-26
DOI
https://doi.org/10.31449/inf.v48i3.6187
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Animation Character Mouth Matching Model Considering Reinforcement Learning and Feature Extraction

Hang Zhao
Informatica
Human Motion and Animation
article

Animation Character Mouth Matching Model Considering Reinforcement Learning and Feature Extraction

Hang Zhao
article en

Abstract

With the development of the times, animation production has become increasingly sophisticated, and mouth matching is one of the key points to ensure the vividness and realism of animated characters. Therefore, a study proposes an animated character mouth matching model that takes into account reinforcement learning and feature extraction. Using the Actor-Critic method in reinforcement learning, the extracted audio and facial features are used as input states to predict the next facial feature in the next time step. The experimental results show that the proposed model has an average accuracy of 95.61% and an F1 value of 97.13% on three databases. Meanwhile, the peak signal-to-noise ratio and structural similarity index are 41.77 and 0.93, respectively, which are better than their comparison methods. In addition, the study tested the error of mouth shape under different emotions, and the results showed an average mean square error of only 6.639. Finally, the user survey results showed that the animated characters generated by the proposed model received more recognition in mouth shape matching and realism, with a highest selection rate of 98.64%. The successful application of the proposed model provides new ideas and methods for research in related fields, laying the foundation for further promotion and innovation of animation production technology.

InformaticaVol. 48(3)
Openalex Percentile: Top 79%
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.