Test-Time Linear Out-of-Distribution Detection

Out-of-Distribution (OOD) detection aims to address the excessive confidence prediction by neural networks by triggering an alert when the input sample deviates significantly from the training distribution (in-distribution), indicating that the output may not be reliable. Current OOD detection appro...

Full description

Saved in:
Bibliographic Details
Published in2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) pp. 23752 - 23761
Main Authors Fan, Ke, Liu, Tong, Qiu, Xingyu, Wang, Yikai, Huai, Lian, Shangguan, Zeyu, Gou, Shuang, Liu, Fengjian, Fu, Yuqian, Fu, Yanwei, Jiang, Xingqun
Format Conference Proceeding
LanguageEnglish
Published IEEE 16.06.2024
Subjects
Feature extraction
Linear regression
Neural networks
Out-of-Distribution Detection
Pattern recognition
Sufficient conditions
Test-Time Adaptation
Training
Online AccessGet full text

Cover

More Information
Summary:Out-of-Distribution (OOD) detection aims to address the excessive confidence prediction by neural networks by triggering an alert when the input sample deviates significantly from the training distribution (in-distribution), indicating that the output may not be reliable. Current OOD detection approaches explore all kinds of cues to identify OOD data, such as finding irregular patterns in the feature space, logit space, gradient space, or the raw image space. Surprisingly, we observe a linear trend between the OOD score produced by current OOD detection algorithms and the network features on several datasets. We conduct a thorough investigation, theoretically and empirically, to analyze and understand the meaning of such a linear trend in OOD detection. This paper proposes a Robust Test-time Linear method (RTL) to utilize such linear trends like a 'free lunch' when we have a batch of data to perform OOD detection. By using a simple linear regression as a test time adaptation, we can make a more precise OOD prediction. We further propose an online variant of the proposed method, which achieves promising performance and is more practical for real applications. Theoretical analysis is given to prove the effectiveness of our methods. Extensive experiments on several OOD datasets show the efficacy of RTL for OOD detection tasks, significantly improving the results of base OOD detectors. Project will be available at https://github.com/kfan21/RTL.
ISSN:2575-7075
DOI:10.1109/CVPR52733.2024.02242