Data-Efficient Pin Defect Detection with Transformer in Transmission Lines

Pin defect is an important component of high-voltage line safety inspection. Due to the harsh environment of the power lines, large-size dataset of pin defects is hard to obtain. DEtection TRansformer (DETR) have achieved great success on large-size datasets, but perform poorly on small-size dataset...

Full description

Saved in:
Bibliographic Details
Published in2023 5th International Conference on Electronic Engineering and Informatics (EEI) pp. 41 - 44
Main Authors Huang, Wenqi, Zeng, Qunsheng, Wu, Yang, Cai, Zhuojun, Zhou, Ruiye, Shang, Jianing, Liang, Lingyu, Li, Xuanang
Format Conference Proceeding
LanguageEnglish
Published IEEE 30.06.2023
Subjects
component
Decoding
DETR
Feature extraction
Inspection
large-size dataset
Pin defects
Pins
Power transmission lines
Redundancy
small-size dataset
Transformers
Online AccessGet full text

Cover

More Information
Summary:Pin defect is an important component of high-voltage line safety inspection. Due to the harsh environment of the power lines, large-size dataset of pin defects is hard to obtain. DEtection TRansformer (DETR) have achieved great success on large-size datasets, but perform poorly on small-size datasets. In this paper, we found that the reasons why DETR-like methods perform poorly on small-size datasets is that there is too much redundancy in the queries in the encoder, making it difficult for the model to attend to sparse objects. Secondly, the object queries in the decoder are randomly initialized and difficult to learn object features. To address these issues, we propose a data-efficient Deformable DETR (DE-Deformable DETR), which includes a sparse encoder and a feature sampling decoder. The sparse encoder reduces computational complexity and accelerates convergence, while the feature sampling decoder uses cascaded sampling for efficient feature extraction. Extensive experiments show that DE-Deformable DETR can improve the performance of DETR-like methods on two small datasets and achieve optimal results.
DOI:10.1109/EEI59236.2023.10212657