Disentangled Representation Learning for 3D Face Shape

• Published in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) pp. 11949 - 11958
• Main Authors: Jiang, Zi-Hang, Wu, Qianyi, Chen, Keyu, Zhang, Juyong
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2019
• Subjects: and Body Pose; Biometrics; Face; Gesture
• ISSN: 2575-7075
• DOI: 10.1109/CVPR.2019.01223

In this paper, we present a novel strategy to design disentangled 3D face shape representation. Specifically, a given 3D face shape is decomposed into identity part and expression part, which are both encoded and decoded in a nonlinear way. To solve this problem, we propose an attribute decomposition framework for 3D face mesh. To better represent face shapes which are usually nonlinear deformed between each other, the face shapes are represented by a vertex based deformation representation rather than Euclidean coordinates. The experimental results demonstrate that our method has better performance than existing methods on decomposing the identity and expression parts. Moreover, more natural expression transfer results can be achieved with our method than existing methods.