Unsupervised Feature Extraction Inspired by Latent Low-Rank Representation

• Published in: 2015 IEEE Winter Conference on Applications of Computer Vision pp. 542 - 549
• Main Authors: Yaming Wang, Morariu, Vlad I., Davis, Larry S.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.01.2015
• Subjects: Algorithm design and analysis; Approximation algorithms; Approximation methods; Feature extraction; Noise; Optimization; Principal component analysis
• ISSN: 1550-5790; 2642-9381
• DOI: 10.1109/WACV.2015.78

Latent Low-Rank Representation (Lat LRR) has the empirical capability of identifying "salient" features. However, the reason behind this feature extraction effect is still not understood. Its optimization leads to non-unique solutions and has high computational complexity, limiting its potential in practice. We show that Lat LRR learns a transformation matrix which suppresses the most significant principal components corresponding to the largest singular values while preserving the details captured by the components with relatively smaller singular values. Based on this, we propose a novel feature extraction method which directly designs the transformation matrix and has similar behavior to Lat LRR. Our method has a simple analytical solution and can achieve better performance with little computational cost. The effectiveness and efficiency of our method are validated on two face recognition datasets.