Detection of Pin Defects in Aerial Images Based on Cascaded Convolutional Neural Network

• Published in: IEEE access Vol. 9; pp. 73071 - 73082
• Main Authors: Xiao, Yewei, Li, Zhiqiang, Zhang, Dongbo, Teng, Lianwei
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: aerial image; Algorithms; Artificial neural networks; cascaded convolutional neural network; Classification; Convolution; Convolutional neural networks; Datasets; Defects; Entropy (Information theory); Fasteners; Feature extraction; Feature maps; hard sample mining; Kernel; Multilayer perceptrons; Neural networks; nonlinear multilayer perceptron; Pin defect; Pins; Power lines; Power transmission lines; Remote sensing; Target detection; Training
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2021.3079172

Pins are standard fasteners in power transmission lines, and the hidden dangers of pins falling off dramatically affects their safe operation. If a pin is missed, it is called pin defects in this paper. As the pin is a small target and has a complex background, traditional detection algorithms were used to identify pin defects from aerial images which suffer from poor accuracy and low efficiency. This paper proposed a target detection method based on cascaded convolutional neural networks. First, a small-scale shallow full convolutional neural network was used to obtain the region of interest; then, a deeper convolutional neural network conducted target classification and positioning on the obtained region of interest. Next, a nonlinear multilayer perceptron was introduced, the convolution kernel was decomposed, and the multi-scale feature maps were fused. At this point, an angle variable was added to the classification cross-entropy loss function. Multi-task learning and offline hard sample mining strategies were used in the training phase. The proposed method was tested on a self-built pin dataset and the remote sensing image RSOD dataset, and the experimental results proved its effectiveness. Our method can accurately identify pin defects in aerial images, thereby solving the engineering application problem of pin defect detection in transmission lines.