Unconstrained Still/Video-Based Face Verification with Deep Convolutional Neural Networks

• Published in: International journal of computer vision Vol. 126; no. 2-4; pp. 272 - 291
• Main Authors: Chen, Jun-Cheng, Ranjan, Rajeev, Sankaranarayanan, Swami, Kumar, Amit, Chen, Ching-Hui, Patel, Vishal M., Castillo, Carlos D., Chellappa, Rama
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.04.2018; Springer; Springer Nature B.V
• Subjects: Artificial Intelligence; Artificial neural networks; Biometry; Computer Imaging; Computer Science; Datasets; Digital video; Face recognition; Image Processing and Computer Vision; Machine learning; Neural networks; Object recognition; Pattern Recognition; Pattern Recognition and Graphics; Performance evaluation; Vision; Deep learning; Face detection/association; Metric learning; Face verification; Fiducial detection
• ISSN: 0920-5691; 1573-1405
• DOI: 10.1007/s11263-017-1029-3

Over the last 5 years, methods based on Deep Convolutional Neural Networks (DCNNs) have shown impressive performance improvements for object detection and recognition problems. This has been made possible due to the availability of large annotated datasets, a better understanding of the non-linear mapping between input images and class labels as well as the affordability of GPUs. In this paper, we present the design details of a deep learning system for unconstrained face recognition, including modules for face detection, association, alignment and face verification. The quantitative performance evaluation is conducted using the IARPA Janus Benchmark A (IJB-A), the JANUS Challenge Set 2 (JANUS CS2), and the Labeled Faces in the Wild (LFW) dataset. The IJB-A dataset includes real-world unconstrained faces of 500 subjects with significant pose and illumination variations which are much harder than the LFW and Youtube Face datasets. JANUS CS2 is the extended version of IJB-A which contains not only all the images/frames of IJB-A but also includes the original videos. Some open issues regarding DCNNs for face verification problems are then discussed.