Suspect identification based on descriptive facial attributes

• Published in: IEEE International Joint Conference on Biometrics pp. 1 - 8
• Main Authors: Klare, Brendan F., Klum, Scott, Klontz, Joshua C., Taborsky, Emma, Akgul, Tayfun, Jain, Anil K.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2014
• Subjects: Abstracts; Face; Glass; Nose
• DOI: 10.1109/BTAS.2014.6996255

We present a method for using human describable face attributes to perform face identification in criminal investigations. To enable this approach, a set of 46 facial attributes were carefully defined with the goal of capturing all describable and persistent facial features. Using crowd sourced labor, a large corpus of face images were manually annotated with the proposed attributes. In turn, we train an automated attribute extraction algorithm to encode target repositories with the attribute information. Attribute extraction is performed using localized face components to improve the extraction accuracy. Experiments are conducted to compare the use of attribute feature information, derived from crowd workers, to face sketch information, drawn by expert artists. In addition to removing the dependence on expert artists, the proposed method complements sketchbased face recognition by allowing investigators to immediately search face repositories without the time delay that is incurred due to sketch generation.