A Method of Classifying Railway Sleepers and Surface Defects in Real Environment

• Published in: IEEE sensors journal Vol. 21; no. 10; pp. 11301 - 11309
• Main Authors: Franca, Andre Stanzani, Vassallo, Raquel Frizera
• Format: Journal Article
• Language: English
• Published: New York IEEE 15.05.2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Automatic optical inspection; Edge detection; Electronic ballasts; Fasteners; Haar transformations; Image processing; Inspection; object detection; Rail transportation; Railroad ties; Rails; railway engineering; Sensors; Surface defects; Topology
• ISSN: 1530-437X; 1558-1748
• DOI: 10.1109/JSEN.2020.3026173

Rail transport is an efficient and safe way to move large quantities of goods and people over long distances but it still suffers from maintenance issues, mainly due to assets of great extent, quantity, weight, and geographic dispersion. Because of this, some initiatives in automatic inspection of railway assets have been developed in recent years/in the last decade. In particular, the automatic inspection of railway sleepers still needs improvement and consolidation. This work presents a method for sleepers inventorying, identification of the type and defects based on image processing, heuristics and feature fusion in an unsupervised way. The Haar transform and integral images are used, as well as other image processing techniques such as edge detection, and entropy computation along with aspects of railroad topology. The algorithm was developed using real images of daily railway, previously unclassified, and that were subject to various noises and variations of a real railway operation. The method was validated through experiments with an image set comprising 32,917 sleepers in 10,116 images. The results are promising in which 97% accuracy is reached, for the identification of the type of sleepers, and 93% accuracy for the identification of visible defects in sleepers.