Time-Varying Surface Reconstruction of an Actor’s Performance

We propose a fully automatic time-varying surface reconstruction of an actor’s performance captured from a production stage through omnidirectional video. The resulting mesh and its texture can then directly be edited in post-production. Our method makes no assumption on the costumes or accessories...

Full description

Saved in:
Bibliographic Details
Published inAdvances in Visual Computing pp. 92 - 101
Main Authors Blache, Ludovic, Desbrun, Mathieu, Loscos, Céline, Lucas, Laurent
Format Book Chapter
LanguageEnglish
Published Cham Springer International Publishing
SeriesLecture Notes in Computer Science
Subjects
Global Deformation
Mesh Deformation
Motion Flow
Virtual Scene
Visual Hull
Online AccessGet full text

Cover

More Information
Summary:We propose a fully automatic time-varying surface reconstruction of an actor’s performance captured from a production stage through omnidirectional video. The resulting mesh and its texture can then directly be edited in post-production. Our method makes no assumption on the costumes or accessories present in the recording. We take as input a raw sequence of volumetric static poses reconstructed from video sequences acquired in a multi-viewpoint chroma-key studio. The first frame is chosen as the reference mesh. An iterative approach is applied throughout the sequence in order to induce a deformation of the reference mesh for all input frames. At first, a pseudo-rigid transformation adjusts the pose to match the input visual hull as closely as possible. Then, local deformation is added to reconstruct fine details. We provide examples of actors’ performance inserted into virtual scenes, including dynamic interaction with the environment.
ISBN:9783319278568
3319278568
ISSN:0302-9743
1611-3349
DOI:10.1007/978-3-319-27857-5_9