Recognizability assessment of facial images for automated teller machine applications

• Published in: Pattern recognition Vol. 45; no. 5; pp. 1899 - 1914
• Main Authors: Suhr, Jae Kyu, Eum, Sungmin, Jung, Ho Gi, Li, Gen, Kim, Gahyun, Kim, Jaihie
• Format: Journal Article
• Language: English
• Published: Kidlington Elsevier Ltd 01.05.2012; Elsevier
• Subjects: Applied sciences; Assessments; Automated teller machine (ATM); Automated teller machines; Component-based face detection; Crime; Exact sciences and technology; Facial; Facial image; Facial occlusion; Illumination; Information, signal and communications theory; Occlusion; Pattern recognition; Recognition; Recognizability assessment; Signal processing; Telecommunications and information theory; Automated teller machine (ATM); Recognizability assessment; Facial occlusion; Facial image; Component-based face detection; Biometrics; Performance evaluation; System architecture; High performance; Grey level image; Face recognition; Vulnerability; Pattern recognition; Implementation; Image method; Partial occlusion; Image sequence; Database; Illumination; Feasibility; Automatic recognition; Asynchronous transfer mode
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2011.11.014

Crimes related to automated teller machines (ATMs) have increased as a result of the recent popularity in the devices. One of the most practical approaches for preventing such crimes is the installation of cameras in ATMs to capture the facial images of users for follow-up criminal investigations. However, this approach is vulnerable in cases where a criminal's face is occluded. Therefore, this paper proposes a system which assesses the recognizability of facial images of ATM users to determine whether their faces are severely occluded. The proposed system uses a component-based face candidate generation and verification approach to handle various facial postures and acceptable partial occlusions. Element techniques are implemented via grayscale image-based methods which are robust against illumination conditions compared to skin color detection approach. The system architecture for achieving both high performance and cost-efficiency is proposed to make the system applicable to practical ATM environments. In the experiment, the feasibility of the proposed system was evaluated using a large-scale facial occlusion database consisting of 3168 image sequences including 21 facial occlusions, 8 illumination conditions, and 2 acquisition scenarios. Based on the results, we drew up the guidelines of recognizability assessment systems for ATM applications. ▶ A novel recognizability assessment method of facial images for ATMs is proposed. ▶ A component-based face candidate generation and verification approach is utilized. ▶ An architecture for achieving high performance and cost-efficiency is suggested. ▶ This method can handle various facial occlusions, postures, and illuminations. ▶ Experimental results using a large-scale facial occlusion database are presented.