Multi-modal fusion high-voltage transmission line inspection method in complex and limited scene

• Main Authors: DAI YANG, PENG ZIYANG, LIU CAIPING, MAO JIANXU, CHEN NUOTIAN, YI JUNFEI, ZHANG HUI, ZHU QING, TAO ZIMING, HE WENBIN, WANG YAONAN
• Format: Patent
• Language: Chinese; English
• Published: 28.05.2024
• Subjects: CALCULATING; COMPUTING; COUNTING; PHYSICS

The invention relates to a multi-modal fusion high-voltage transmission line inspection method in a complex limited scene. The method comprises the following steps: acquiring a two-dimensional diagram and three-dimensional point cloud data of a high-voltage transmission line; based on the two-dimensional diagram and the three-dimensional point cloud data, constructing a high-voltage transmission line detection data set, and dividing the data set into a training set and a verification set in proportion; constructing a multi-modal fusion perception high-voltage transmission line inspection model; the high-voltage transmission line inspection model comprises a depth completion module, a voxel screening module, an anti-noise convolution module and a multi-task detection head prediction module; training the high-voltage transmission line inspection model based on the training set; and inputting the verification set into a trained high-voltage transmission line inspection model, screening through a post-processing