Label-Assisted Memory Autoencoder for Unsupervised Out-of-Distribution Detection

• Published in: Machine Learning and Knowledge Discovery in Databases. Research Track Vol. 12977; pp. 795 - 810
• Main Authors: Zhang, Shuyi, Pan, Chao, Song, Liyan, Wu, Xiaoyu, Hu, Zheng, Pei, Ke, Tino, Peter, Yao, Xin
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2021; Springer International Publishing
• Series: Lecture Notes in Computer Science
• ISBN: 3030865223; 9783030865221
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-86523-8_48

Out-of-Distribution (OoD) detectors based on AutoEncoder (AE) rely on an underlying assumption that an AE network cannot reconstruct OoD data as good as in-distribution (ID) data when it is constructed based on ID data only. However, this assumption may be violated in practice, resulting in a degradation in detection performance. Therefore, alleviating the factors violating this assumption can potentially improve the robustness of OoD performance. Our empirical studies also show that image complexity can be another factor hindering detection performance for AE-based detectors. To cater for these issues, we propose two OoD detectors LAMAE and LAMAE+. Both can be trained without the availability of any OoD-related data. The key idea is to regularize the AE network architecture with a classifier and a label-assisted memory to confine the reconstruction of OoD data while retaining the reconstruction ability for ID data. We also adjust the reconstruction error by taking image complexity into consideration. Experimental studies show that the proposed OoD detectors can perform well on a wider range of OoD scenarios.