A review of state-of-the-art in Face Presentation Attack Detection: From early development to advanced deep learning and multi-modal fusion methods

• Published in: Information fusion Vol. 75; pp. 55 - 69
• Main Authors: Abdullakutty, Faseela, Elyan, Eyad, Johnston, Pamela
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.11.2021
• Subjects: Deep learning; Face Recognition; Generalisation; Presentation attacks; Deep learning; Presentation attacks; Generalisation; Face Recognition
• ISSN: 1566-2535; 1872-6305
• DOI: 10.1016/j.inffus.2021.04.015

Face Recognition is considered one of the most common biometric solutions these days and is widely used across a range of devices for various security purposes. The performance of FR systems has improved by orders of magnitude over the past decade. This is mainly due to the latest developments in computer vision and deep convolutional neural networks, and the availability of large training datasets. At the same time, these systems have been subject to various types of attacks. Presentation attacks are common, simple, and easy to implement. These simply involve presenting a video, photo, or mask to the camera or digital sensor and have proven capable of fooling FR systems and providing access to unauthorised users. Presentation attack detection is increasingly attracting more attention in the research community. A wide range of methods has already been developed to address this challenge. Deep learning-based methods in particular have shown very promising results. However, existing literature suggests that even with state-of-the-art methods, performance drops significantly in cross-dataset evaluation. We present a thorough, comprehensive, and technical review of existing literature on this timely and challenging problem. We first introduce and discuss the presentation attack problem and cover related and recent work in this area. In-depth technical details of existing presentation attack detection methods are then presented and critically discussed and evaluated, followed by a comprehensive discussion and evaluation of existing public datasets and commonly used evaluation metrics. Our review shows clearly that despite the recent and significant advances in this area of research, detecting unseen attacks is still considered a key problem. Machine learning methods tend to perform well, but only when test data comes from the same distribution as the training data (i.e. same dataset). New research directions are discussed in detail, including ways to improve the generalisation of machine learning methods, and move towards creating more stable presentation attack detection techniques that generalise across a wide range of unseen samples. •Face Presentation Attacks pose a serious challenge to Face Recognition (FR).•A critical review of various types of presentation attacks on FR.•An extensive and critical evaluation of presentation attack detection methods.•A detailed discussion on challenges, limitations, and public datasets in this area.•Research gaps and future directions towards more stable detection methods.