Geometry-Guided Dense Perspective Network for Speech-Driven Facial Animation

• Published in: IEEE transactions on visualization and computer graphics Vol. 28; no. 12; pp. 4873 - 4886
• Main Authors: Liu, Jingying, Hui, Binyuan, Li, Kun, Liu, Yunke, Lai, Yu-Kun, Zhang, Yuxiang, Liu, Yebin, Yang, Jingyu
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.12.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: 3D facial animation; Animation; Coders; Correlation; Datasets; Decoding; Deformation; Face recognition; Facial animation; Geometry; geometry-guided; Image reconstruction; Solid modeling; speaker-independent; Speech; Speech-driven; Three-dimensional displays

Realistic speech-driven 3D facial animation is a challenging problem due to the complex relationship between speech and face. In this paper, we propose a deep architecture, called Geometry-guided Dense Perspective Network (GDPnet) , to achieve speaker-independent realistic 3D facial animation. The e...