Computation of CNN’s Sensitivity to Input Perturbation

• Published in: Neural processing letters Vol. 53; no. 1; pp. 535 - 560
• Main Authors: Xiang, Lin, Zeng, Xiaoqin, Wu, Shengli, Liu, Yanjun, Yuan, Baohua
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.02.2021; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Artificial neural networks; Complex Systems; Computational Intelligence; Computer Science; Iterative algorithms; Iterative methods; Measurement methods; Neural networks; Neurons; Perturbation; Sensitivity; Sensitivity analysis; Additive noise; Sensitivity; Input perturbation; Convolutional neural network
• ISSN: 1370-4621; 1573-773X
• DOI: 10.1007/s11063-020-10420-7

Although Convolutional Neural Networks (CNNs) are considered as being "approximately invariant" to nuisance perturbations such as image transformation, shift, scaling, and other small deformations, some existing studies show that intense noises can cause noticeable variation to CNNs’ outputs. This paper focuses on exploring a method of measuring sensitivity by observing corresponding output variation to input perturbation on CNNs. The sensitivity is statistically defined in a bottom-up way from neuron to layer, and finally to the entire CNN network. An iterative algorithm is proposed for approximating the defined sensitivity. On the basic architecture of CNNs, the theoretically computed sensitivity is verified on the MNIST database with four types of commonly used noise distributions: Gaussian, Uniform, Salt and Pepper, and Rayleigh. Experimental results show the theoretical sensitivity is on the one hand in agreement with the actual output variation what on the maps, layers or entire networks are, and on the other hand an applicable quantitative measure for robust network selection.