A fast and efficient approach to human animation generation via frame difference

Generating Three-Dimensional Animation of Virtual Characters Based on Monocular RGB Video represents a cutting-edge technological application in the field of computer graphics. Initially, monocular video serves as input data, from which the three-dimensional coordinate information of characters is extracted. Subsequently, this data is mapped onto any three-dimensional character model, enabling the generation of three-dimensional animation corresponding to any character action portrayed in the video. This paper aims to generate three-dimensional animation of virtual characters, leveraging frame interpolation and deep learning methods for implementation. The innovation of this paper primarily lies in the extraction of key frames from the video using frame interpolation. Furthermore, interstitial frame character action data between each key frame is predicted and generated through a neural network model. The resulting three-dimensional animation of characters demonstrates high quality and smoothness.

Authors

Institutions

Publication Details

Published
2024-08-16
DOI
https://doi.org/10.1117/12.3035731
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A fast and efficient approach to human animation generation via frame difference

Biwei Liu
Human Motion and Animation
article

A fast and efficient approach to human animation generation via frame difference

Biwei Liu
article en

Abstract

Generating Three-Dimensional Animation of Virtual Characters Based on Monocular RGB Video represents a cutting-edge technological application in the field of computer graphics. Initially, monocular video serves as input data, from which the three-dimensional coordinate information of characters is extracted. Subsequently, this data is mapped onto any three-dimensional character model, enabling the generation of three-dimensional animation corresponding to any character action portrayed in the video. This paper aims to generate three-dimensional animation of virtual characters, leveraging frame interpolation and deep learning methods for implementation. The innovation of this paper primarily lies in the extraction of key frames from the video using frame interpolation. Furthermore, interstitial frame character action data between each key frame is predicted and generated through a neural network model. The resulting three-dimensional animation of characters demonstrates high quality and smoothness.

Changchun University of Science and Technology (CN)
Openalex Percentile: Top 86%
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A fast and efficient approach to human animation generation via frame difference — Biwei Liu · (2024) | TGRS Research Map | TGRS