Photo Wake-Up: 3D Character Animation From a Single Photo

We present a method and application for animating a human subject from a single photo. E.g., the character can walk out, run, sit, or jump in 3D. The key contributions of this paper are: 1) an application of viewing and animating humans in single photos in 3D, 2) a novel 2D warping method to deform...

Full description

Saved in:
Bibliographic Details
Published inProceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 5901 - 5910
Main Authors Weng, Chung-Yi, Curless, Brian, Kemelmacher-Shlizerman, Ira
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.06.2019
Subjects
3D from Single Image; Computational Photography; Image and Video Synthesis
Animation
Augmented reality
Computer vision
Deformable models
Pattern recognition
Solid modeling
Three-dimensional displays
Vision + Graphics
Online AccessGet full text

Cover

More Information
Summary:We present a method and application for animating a human subject from a single photo. E.g., the character can walk out, run, sit, or jump in 3D. The key contributions of this paper are: 1) an application of viewing and animating humans in single photos in 3D, 2) a novel 2D warping method to deform a posable template body model to fit the person's complex silhouette to create an animatable mesh, and 3) a method for handling partial self occlusions. We compare to state-of-the-art related methods and evaluate results with human studies. Further, we present an interactive interface that allows re-posing the person in 3D, and an augmented reality setup where the animated 3D person can emerge from the photo into the real world. We demonstrate the method on photos, posters, and art. The project page is at https://grail.cs.washington.edu/projects/wakeup/.
ISSN:1063-6919
DOI:10.1109/CVPR.2019.00606