ShuffleDetect: Detecting Adversarial Images against Convolutional Neural Networks

• Published in: Applied sciences Vol. 13; no. 6; p. 4068
• Main Authors: Chitic, Raluca, Topal, Ali Osman, Leprévost, Franck
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.03.2023
• Subjects: adversarial attacks; Algorithms; Classification; convolutional neural networks; detection; Detectors; Evaluation; evolutionary algorithms; Neural networks; Performance assessment; Permutations; security; Sensors
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app13064068

Recently, convolutional neural networks (CNNs) have become the main drivers in many image recognition applications. However, they are vulnerable to adversarial attacks, which can lead to disastrous consequences. This paper introduces ShuffleDetect as a new and efficient unsupervised method for the detection of adversarial images against trained convolutional neural networks. Its main feature is to split an input image into non-overlapping patches, then swap the patches according to permutations, and count the number of permutations for which the CNN classifies the unshuffled input image and the shuffled image into different categories. The image is declared adversarial if and only if the proportion of such permutations exceeds a certain threshold value. A series of 8 targeted or untargeted attacks was applied on 10 diverse and state-of-the-art ImageNet-trained CNNs, leading to 9500 relevant clean and adversarial images. We assessed the performance of ShuffleDetect intrinsically and compared it with another detector. Experiments show that ShuffleDetect is an easy-to-implement, very fast, and near memory-free detector that achieves high detection rates and low false positive rates.