Audio-Visual Biometric Recognition and Presentation Attack Detection: A Comprehensive Survey

• Published in: IEEE access Vol. 9; pp. 37431 - 37455
• Main Authors: Mandalapu, Hareesh, Reddy P N, Aravinda, Ramachandra, Raghavendra, Rao, Krothapalli Sreenivasa, Mitra, Pabitra, Prasanna, S. R. Mahadeva, Busch, Christoph
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Ascent; Audio data; audio-visual person recognition; Authentication; Biometrics; Biometrics (access control); Biosensors; Face recognition; Feature extraction; presentation attack detection; Smartphones; Tablet computers; Visualization
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2021.3063031

Biometric recognition is a trending technology that uses unique characteristics data to identify or verify/authenticate security applications. Amidst the classically used biometrics, voice and face attributes are the most propitious for prevalent applications in day-to-day life because they are easy to obtain through restrained and user-friendly procedures. The pervasiveness of low-cost audio and face capture sensors in smartphones, laptops, and tablets has made the advantage of voice and face biometrics more exceptional when compared to other biometrics. For many years, acoustic information alone has been a great success in automatic speaker verification applications. Meantime, the last decade or two has also witnessed a remarkable ascent in face recognition technologies. Nonetheless, in adverse unconstrained environments, neither of these techniques achieves optimal performance. Since audio-visual information carries correlated and complementary information, integrating them into one recognition system can increase the system's performance. The vulnerability of biometrics towards presentation attacks and audio-visual data usage for the detection of such attacks is also a hot topic of research. This paper made a comprehensive survey on existing state-of-the-art audio-visual recognition techniques, publicly available databases for benchmarking, and Presentation Attack Detection (PAD) algorithms. Further, a detailed discussion on challenges and open problems is presented in this field of biometrics.