OUTCOME Virtual: a tool for automatically creating virtual character animations’ from human videos

In this article, we present a new open-source tool, called OUTCOME Virtual, to automatically replicate humans’ behaviors on virtual characters. The tool takes as input a human video and extracts action units, head movements, and gaze direction to animate a virtual character’s face and head with the synchronized speech in Unity. The tool is designed to be easily configured, in particular concerning the association between actions units and blend shapes, and with a user-friendly interface to select the appearance of virtual characters, the lip synchronization and the noise-correction option. The tool is illustrated in this paper with the generation of listener feedback.

Authors

Institutions

Publication Details

Published
2024-09-16
DOI
https://doi.org/10.1145/3652988.3696196
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

OUTCOME Virtual: a tool for automatically creating virtual character animations’ from human videos

Auriane Boudin, Magalie Ochs, Alexandre D’Ambra, Philippe Blache et al.
Human Motion and Animation
article

OUTCOME Virtual: a tool for automatically creating virtual character animations’ from human videos

Auriane Boudin, Magalie Ochs, Alexandre D’Ambra, Philippe Blache, Jean-Marie Pergandi, Ivan Derban
article en

Abstract

In this article, we present a new open-source tool, called OUTCOME Virtual, to automatically replicate humans’ behaviors on virtual characters. The tool takes as input a human video and extracts action units, head movements, and gaze direction to animate a virtual character’s face and head with the synchronized speech in Unity. The tool is designed to be easily configured, in particular concerning the association between actions units and blend shapes, and with a user-friendly interface to select the appearance of virtual characters, the lip synchronization and the noise-correction option. The tool is illustrated in this paper with the generation of listener feedback.

Centre National de la Recherche Scientifique (FR), Aix-Marseille Université (FR), Institut des Sciences Moléculaires (FR), Laboratoire d’Informatique et Systèmes (FR)
Aix-Marseille Université, Agence Nationale de la Recherche
Openalex Percentile: Top 71%
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

OUTCOME Virtual: a tool for automatically creating virtual character animations’ from human videos — Auriane Boudin, Magalie Ochs, et al. · (2024) | TGRS Research Map | TGRS