Face recognition based on the multi-scale local image structures

• Published in: Pattern recognition Vol. 44; no. 10; pp. 2565 - 2575
• Main Authors: Geng, Cong, Jiang, Xudong
• Format: Journal Article
• Language: English
• Published: Kidlington Elsevier Ltd 01.10.2011; Elsevier
• Subjects: Applied sciences; Detection, estimation, filtering, equalization, prediction; Exact sciences and technology; Face recognition; Feature extraction; Galleries; Image matching; Image processing; Information, signal and communications theory; Keypoint detection; Local image structure; Matching; Pattern recognition; Signal and communications theory; Signal processing; Signal, noise; Strategy; Tasks; Telecommunications and information theory; Template selection; Template synthesis; Visual; Keypoint detection; Template synthesis; Face recognition; Image matching; Template selection; Feature extraction; Local image structure; Biometrics; Performance evaluation; Multistage method; Image processing; Pattern recognition; Algorithm; Multiple image; Learning; Multiscale method; Signal processing; Automatic recognition
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2011.03.011

This paper proposes a framework of face recognition based on the multi-scale local structures of the face image. While some basic tools in this framework are inherited from the SIFT algorithm, this work investigates and contributes to all major steps in the feature extraction and image matching. New approaches to keypoint detection, partial descriptor and insignificant keypoint removal are proposed specifically for human face images, a type of non-rigid and smooth visual objects. A strategy of keypoint search for the nearest subject and a two-stage image matching scheme are developed for the face identification task. They circumvent the problem that local structures matched with those in probe disperse into many different gallery images. Although the proposed framework can work for single template per subject, a training procedure is developed for multiple samples per subject. It contains template selection, unstable keypoint removal and template synthesis to meet different requirements in face recognition applications. Each ingredient of the proposed framework is experimentally validated and compared with its counterpart in the SIFT scheme. Results show that the proposed framework outperforms SIFT and some holistic approaches to face recognition. ► Keypoint detection, partial descriptor and insignificant keypoint removal. ► Keypoint search for the nearest subject and a two-stage image matching scheme. ► Template selection, unstable keypoint removal and template synthesis.