3D Face Reconstruction Using Images from Cameras with Varying Parameters

• Published in: International journal of automation and computing Vol. 14; no. 6; pp. 661 - 671
• Main Authors: Merras, Mostafa, El Hazzat, Soulaiman, Saaidi, Abderrahim, Satori, Khalid, Nazih, Abderrazak Gadhi
• Format: Journal Article
• Language: English
• Published: Beijing Institute of Automation, Chinese Academy of Sciences 01.12.2017; Springer Nature B.V
• Subjects: CAE) and Design; Cameras; Computer Applications; Computer-Aided Engineering (CAD; Control; Cost function; Engineering; Finite element method; Genetic algorithms; Image reconstruction; Matrices (mathematics); Mechatronics; Nonlinear equations; Parameters; Research Article; Robotics; Symmetry; Texture mapping; Three dimensional models; genetic algorithm; 3D mesh; Camera calibration; 3D reconstruction; 3D face
• ISSN: 1476-8186; 2153-182X; 1751-8520; 2153-1838
• DOI: 10.1007/s11633-016-0999-x

In this paper, we present a new technique of 3D face reconstruction from a sequence of images taken with cameras having varying parameters without the need to grid. This method is based on the estimation of the projection matrices of the cameras from a symmetry property which characterizes the face, these projections matrices are used with points matching in each pair of images to determine the 3D points cloud, subsequently, 3D mesh of the face is constructed with 3D Crust algorithm. Lastly, the 2D image is projected on the 3D model to generate the texture mapping. The strong point of the proposed approach is to minimize the constraints of the calibration system： we calibrated the cameras from a symmetry property which characterizes the face, this property gives us the opportunity to know some points of 3D face in a specific well-chosen global reference, to formulate a system of linear and nonlinear equations according to these 3D points, their projection in the image plan and the elements of the projections matrix. Then to solve these equations, we use a genetic algorithm which consists of finding the global optimum without the need of the initial estimation and allows to avoid the local minima of the formulated cost function. Our study is conducted on real data to demonstrate the validity and the performance of the proposed approach in terms of robustness, simplicity, stability and convergence.