Sparse graphical representation based discriminant analysis for heterogeneous face recognition

• Published in: Signal processing Vol. 156; pp. 46 - 61
• Main Authors: Peng, Chunlei, Gao, Xinbo, Wang, Nannan, Li, Jie
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.03.2019
• Subjects: Composite sketch; Discriminant analysis; Forensic sketch; Heterogeneous face recognition; Infrared image; Thermal image; Viewed sketch; Composite sketch; Discriminant analysis; Viewed sketch; Thermal image; Forensic sketch; Heterogeneous face recognition; Infrared image
• ISSN: 0165-1684; 1872-7557
• DOI: 10.1016/j.sigpro.2018.10.015

•We propose an adaptive sparse graphical representation scheme to represent heterogeneous face images. By skipping the K nearest neighbor selection process, adaptive sparse vectors can be generated from the Markov networks model, which is evaluated to be much more effective for heterogeneous face recognition.•We develop a spatial partition-based discriminant analysis framework for heterogeneous face matching. With the proposed spatial partition strategies, the discriminability of heterogeneous face images is improved.•Extensive heterogeneous face recognition experiments in comparison with both traditional and deep learning based approaches show the effectiveness of our SGR-DA method. Face images captured in heterogeneous environments, e.g., sketches generated by the artists or composite-generation software, photos taken by common cameras and infrared images captured by corresponding infrared imaging devices, are usually subject to large texture (i.e., style) differences. This results in heavily degraded performance of conventional face recognition methods directly applied on heterogeneous face images. In this paper, we propose a novel sparse graphical representation based discriminant analysis (SGR-DA) approach to address aforementioned cross-modality face recognition scenarios. An adaptive sparse graphical representation scheme is designed to represent face images from different modalities, where a Markov networks model is constructed to generate adaptive sparse vectors. To handle the complex facial structure and further improve the discriminability, a spatial partition-based discriminant analysis framework is presented to refine the adaptive sparse vectors for face matching. We conducted experiments on six commonly used heterogeneous face datasets and experimental comparison with both traditional and deep learning based approaches illustrated the superiority of our proposed SGR-DA.