Composite sketch recognition using saliency and attribute feedback

• Published in: Information fusion Vol. 33; pp. 86 - 99
• Main Authors: Mittal, Paritosh, Jain, Aishwarya, Goswami, Gaurav, Vatsa, Mayank, Singh, Richa
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.01.2017
• Subjects: Biometrics; Composite sketch; Face recognition; Saliency; Sketch recognition; Biometrics; Composite sketch; Saliency; Sketch recognition; Face recognition
• ISSN: 1566-2535; 1872-6305
• DOI: 10.1016/j.inffus.2016.04.003

•Propose composite sketch to photo matching algorithm using visual saliency and combination of texture features.•Attributes such as gender and ethnicity information is used to improve recognition performance.•Multiple experts such as sketches from different artists are combined for further increasing accuracy. Recent interest and requirement of law enforcement agencies in matching composite sketches with digital images has instigated research in this important face recognition problem. In this paper, we propose feature extraction and matching algorithm using visual saliency and combination of texture features for matching composite sketches with digital photos. The attributes such as gender, ethnicity, and skin color are utilized for re-ordering the ranked list. Further, information from multiple experts such as multiple composite sketch generation tools or artists is combined for improving the matching performance. The results obtained on the extended PRIP database show that the proposed algorithm improves the state-of-art in matching composite sketch and digital face images and yields the rank 50 identification accuracy of 70.3% on a database of 1500 subjects.