OUTCOME Virtual: a tool for automatically creating virtual character animations’ from human videos
In this article, we present a new open-source tool, called OUTCOME Virtual, to automatically replicate humans’ behaviors on virtual characters. The tool takes as input a human video and extracts action units, head movements, and gaze direction to animate a virtual character’s face and head with the synchronized speech in Unity. The tool is designed to be easily configured, in particular concerning the association between actions units and blend shapes, and with a user-friendly interface to select the appearance of virtual characters, the lip synchronization and the noise-correction option. The tool is illustrated in this paper with the generation of listener feedback.
Authors
- Auriane Boudin (ORCID: https://orcid.org/0000-0001-5197-4903)
- Magalie Ochs (ORCID: https://orcid.org/0000-0001-7919-5688)
- Alexandre D’Ambra (ORCID: https://orcid.org/0009-0009-9991-1528)
- Philippe Blache (ORCID: https://orcid.org/0000-0002-5216-9591)
- Jean-Marie Pergandi
- Ivan Derban
Institutions
- Centre National de la Recherche Scientifique (FR)
- Aix-Marseille Université (FR)
- Institut des Sciences Moléculaires (FR)
- Laboratoire d’Informatique et Systèmes (FR)
Publication Details
- Published
- 2024-09-16
- DOI
- https://doi.org/10.1145/3652988.3696196
- Primary Topic
- Human Motion and Animation
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Aix-Marseille Université
- Agence Nationale de la Recherche