3D face texture modeling from uncalibrated frontal and profile images

• Published in: 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems pp. 223 - 230
• Main Authors: Hu Han, Jain, A. K.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2012
• Subjects: Face; Face recognition; Image recognition; Lighting; Shape; Solid modeling
• ISBN: 9781467313841; 146731384X
• DOI: 10.1109/BTAS.2012.6374581

3D face modeling from 2D face images is of significant importance for face analysis, animation and recognition. Previous research on this topic mainly focused on 3D face modeling from a single 2D face image; however, a single face image can only provide a limited description of a 3D face. In many applications, for example, law enforcement, multi-view face images are usually captured for a subject during enrollment, which makes it desirable to build a 3D face texture model, given a pair of frontal and profile face images. We first determine the correspondence between un-calibrated frontal and profile face images through facial landmark alignment. An initial 3D face shape is then reconstructed from the frontal face image, followed by shape refinement utilizing the depth information provided by the profile image. Finally, face texture is extracted by mapping the frontal face image on the recovered 3D face shape. The proposed method is utilized for 2D face recognition in two scenarios: (i) normalization of probe image, and (ii) enhancing the representation capability of gallery set. Experimental results comparing the proposed method with a state-of-the-art commercial face matcher and densely sampled LBP on a subset of the FERET database show the effectiveness of the proposed 3D face texture model.