Neural Network Based Algorithms for Traffic Lights Identification in Multi-Camera Driver Assistance Systems

• Published in: Gyroscopy and navigation (Online) Vol. 15; no. 3; pp. 244 - 255
• Main Authors: Guzhva, N. S., Sadekov, R. N.
• Format: Journal Article
• Language: English
• Published: Moscow Pleiades Publishing 01.09.2024; Springer Nature B.V
• Subjects: Aerospace Technology and Astronautics; Algorithms; Cameras; Control systems; Engineering; Geophysics/Geodesy; Kalman filters; Matching; Neural networks; Traffic signals; Trams; traffic lights recognition; traffic lights detection; monocular camera; unmanned tram; computer vision
• ISSN: 2075-1087; 2075-1109
• DOI: 10.1134/S2075108724700342

The paper considers the problem of traffic lights recognition (detection, filtering and map-matching) using successive images in active tram driver assistance systems equipped with multiple cameras with different focal lengths. The procedure of the problem solution is described in detail, from measurements (detections) formed at the neural network output for each of the cameras, and up to the results matching with a map. In contrast to other studies of this subject, the authors of this work use 3D measurements as the output data for the neural network, and unscented Kalman filter (UKF) for determining the position of the traffic lights; in addition, a new method for fusing the data from two cameras is applied. The efficiency of the proposed algorithms and its modification has been field-tested. The results of experiments have shown that the algorithm provides the accuracy of 76.19% and completeness of 97.46% when used in combination with the tram control system with two cameras.