Driving Behavior Classification and Sharing System Using CNN-LSTM Approaches and V2X Communication

• Published in: Applied sciences Vol. 11; no. 21; p. 10420
• Main Authors: Kwon, Seong Kyung, Seo, Ji Hwan, Yun, Jun Young, Kim, Kyoung-Dae
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.11.2021
• Subjects: Accelerometers; Accidents; Accuracy; Aggressive behavior; Aggressiveness; Automobile industry; Behavior; Cameras; Classification; CNN-LSTM; Communication; Communications systems; Control algorithms; Datasets; Deep learning; Defensive behavior; Driving; Driving ability; driving behavior classification; driving safety; Efficiency; Environmental factors; Neural networks; Sensors; Simulation; Smartphones; Three axis; Time series; Traffic accidents; Traffic accidents & safety; Traffic congestion; Traffic jams; Transportation systems; Vehicles
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app112110420

Despite advances in autonomous driving technology, traffic accidents remain a problem to be solved in the transportation system. More than half of traffic accidents are due to unsafe driving. In addition, aggressive driving behavior can lead to traffic jams. To reduce this, we propose a 4-layer CNN-2 stack LSTM-based driving behavior classification and V2X sharing system that uses time-series data as an input to reflect temporal changes. The proposed system classifies driving behavior into defensive, normal, and aggressive driving using only the 3-axis acceleration of the driving vehicle and shares it with the surroundings. We collect a training dataset by composing a road that reflects various environmental factors using a driving simulator that mimics a real vehicle and IPG CarMaker, an autonomous driving simulation. Additionally, driving behavior datasets are collected by driving real-world DGIST campus to augment training data. The proposed network has the best performance compared to the state-of-the-art CNN, LSTM, and CNN-LSTM. Finally, our system shares the driving behavior classified by 4-layer CNN-2 stacked LSTM with surrounding vehicles through V2X communication. The proposed system has been validated in ACC simulations and real environments. For real world testing, we configure NVIDIA Jetson TX2, IMU, GPS, and V2X devices as one module. We performed the experiments of the driving behavior classification and V2X transmission and reception in a real world by using the prototype module. As a result of the experiment, the driving behavior classification performance was confirmed to be ~98% or more in the simulation test and 97% or more in the real-world test. In addition, the V2X communication delay through the prototype was confirmed to be an average of 4.8 ms. The proposed system can contribute to improving the safety of the transportation system by sharing the driving behaviors of each vehicle.