Removal of 3D facial expressions: A learning-based approach

• Published in: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition pp. 2614 - 2621
• Main Authors: Gang Pan, Song Han, Zhaohui Wu, Yuting Zhang
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2010
• Subjects: Computer science; Deformable models; Degradation; Face recognition; Interpolation; Mesh generation; Muscles; Prototypes; Shape
• ISBN: 1424469848; 9781424469840
• ISSN: 1063-6919; 1063-6919
• DOI: 10.1109/CVPR.2010.5539974

This paper focuses on the task of recovering the neutral 3D face of a person when given his/her 3D face model with facial expression. We propose a learning-based expression removal framework to tackle this task. Our basic idea is to model expression residue from samples, and then use the inferred expression residue from the input expressional face model to recover the neutral one. A two-step non-rigid alignment method is introduced to make all the face models topologically share a common structure. Then we construct two spaces, normal space and expression residue space, for modeling expression. Therefore, the expression removal problem can be formalized as the inference of expression residue from normal spaces. The neutral face model can be generated in a Poisson-based framework by the inferred expression residue. The experimental results on BU-3DFED database demonstrate the effectiveness of our approach.