Annotated face model-based alignment: a robust landmark-free pose estimation approach for 3D model registration

• Published in: Machine vision and applications Vol. 29; no. 3; pp. 375 - 391
• Main Authors: Wu, Yuhang, Shah, Shishir K., Kakadiaris, Ioannis A.
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.04.2018; Springer Nature B.V
• Subjects: Communications Engineering; Computer Science; Face recognition; Identification methods; Image Processing and Computer Vision; Landmarks; Networks; Original Paper; Parameter estimation; Pattern Recognition; Pose estimation; Three dimensional models; Two dimensional models; Vision systems; Model registration; Face recognition; Pose estimation; Face alignment
• ISSN: 0932-8092; 1432-1769
• DOI: 10.1007/s00138-017-0887-6

Registering a 3D facial model onto a 2D image is important for constructing pixel-wise correspondences between different facial images. The registration is based on a 3 × 4 dimensional projection matrix, which is obtained from pose estimation. Conventional pose estimation approaches employ facial landmarks to determine the coefficients inside the projection matrix and are sensitive to missing or incorrect landmarks. In this paper, a landmark-free pose estimation method is presented. The method can be used to estimate the matrix when facial landmarks are not available. Experimental results show that the proposed method outperforms several landmark-free pose estimation methods and achieves competitive accuracy in terms of estimating pose parameters. The method is also demonstrated to be effective as part of a 3D-aided face recognition pipeline (UR2D), whose rank-1 identification rate is competitive to the methods that use landmarks to estimate head pose.