Deep Learning Face Representation from Predicting 10,000 Classes

• Published in: 2014 IEEE Conference on Computer Vision and Pattern Recognition pp. 1891 - 1898
• Main Authors: Sun, Yi, Wang, Xiaogang, Tang, Xiaoou
• Format: Conference Proceeding Journal Article
• Language: English
• Published: IEEE 01.06.2014
• Subjects: Activation; Bayes methods; Biological neural networks; Classifiers; Computer vision; deep learning; Face; face verification; Feature extraction; Joints; Learning; Neurons; Pattern recognition; Representations; Tasks; Training
• ISSN: 1063-6919; 1063-6919; 2575-7075
• DOI: 10.1109/CVPR.2014.244

This paper proposes to learn a set of high-level feature representations through deep learning, referred to as Deep hidden IDentity features (DeepID), for face verification. We argue that DeepID can be effectively learned through challenging multi-class face identification tasks, whilst they can be generalized to other tasks (such as verification) and new identities unseen in the training set. Moreover, the generalization capability of DeepID increases as more face classes are to be predicted at training. DeepID features are taken from the last hidden layer neuron activations of deep convolutional networks (ConvNets). When learned as classifiers to recognize about 10, 000 face identities in the training set and configured to keep reducing the neuron numbers along the feature extraction hierarchy, these deep ConvNets gradually form compact identity-related features in the top layers with only a small number of hidden neurons. The proposed features are extracted from various face regions to form complementary and over-complete representations. Any state-of-the-art classifiers can be learned based on these high-level representations for face verification. 97:45% verification accuracy on LFW is achieved with only weakly aligned faces.