Drowsiness monitoring based on driver and driving data fusion

• Published in: 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC) pp. 1199 - 1204
• Main Authors: Daza, I. G., Hernandez, N., Bergasa, L. M., Parra, I., Yebes, J. J., Gavilan, M., Quintero, R., Llorca, D. F., Sotelo, M. A.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2011
• Subjects: Artificial Neural Network; Biological neural networks; Confusion Matrix; Driver Drowsiness; Frequency domain analysis; Helium; Intelligent Transportation Systems; PERcentage of eye CLOSure (PERCLOS); Sleep; Spectral Density Power; Time domain analysis; Vehicles; Visual Fatigue Behaviour; Wheels
• ISBN: 9781457721984; 1457721988
• ISSN: 2153-0009; 2153-0017
• DOI: 10.1109/ITSC.2011.6082907

This paper presents a non-intrusive approach for monitoring driver drowsiness, based on driver and driving data fusion. The Percentage of Eye Closure (PERCLOS) is used to estimate the driver's state. The PERCLOS is computed on real time using a stereo vision-based system. The driving information used is the lateral position, the steering wheel angle and the heading error provided by the CAN bus. These three signals have been studied in the time and frequency domain. A multilayer perceptron neural network has been trained to fetch an optimal performance score. This system was installed in a naturalistic driving simulator. For evaluation purposes, several experiments were designed by psychologists and carried out with professional drivers. As ground truth, subjective experts' manual annotation of the driver video sequences and driving signals was used. A detection rate of 70% using individual indicators was raised up to 94% with the combination of indicators. An explanation about these results and some conclusion are presented.