Toward Development of a Face Recognition System for Watchlist Surveillance

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 33; no. 10; pp. 1925 - 1937
• Main Authors: Kamgar-Parsi, B., Lawson, W.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.10.2011; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Airports; automatic surveillance; Automation; Biometric Identification - methods; biometrics; Cameras; Experiments; Face; Face - anatomy & histology; Face recognition; human-like classification; Humans; Image Processing, Computer-Assisted - methods; Machine vision; morphing facial images; open world face recognition; Probes; Studies; Surveillance; Terrorism; Watches
• DOI: 10.1109/TPAMI.2011.68
• ISSN: 0162-8828; 1939-3539

The interest in face recognition is moving toward real-world applications and uncontrolled sensing environments. An important application of interest is automated surveillance, where the objective is to recognize and track people who are on a watchlist. For this open world application, a large number of cameras that are increasingly being installed at many locations in shopping malls, metro systems, airports, etc., will be utilized. While a very large number of people will approach or pass by these surveillance cameras, only a small set of individuals must be recognized. That is, the system must reject every subject unless the subject happens to be on the watchlist. While humans routinely reject previously unseen faces as strangers, rejection of previously unseen faces has remained a difficult aspect of automated face recognition. In this paper, we propose an approach motivated by human perceptual ability of face recognition which can handle previously unseen faces. Our approach is based on identifying the decision region(s) in the face space which belong to the target person(s). This is done by generating two large sets of borderline images, projecting just inside and outside of the decision region. For each person on the watchlist, a dedicated classifier is trained. Results of extensive experiments support the effectiveness of our approach. In addition to extensive experiments using our algorithm and prerecorded images, we have conducted considerable live system experiments with people in realistic environments.