Driver Drowsiness Detection Using Multi-Channel Second Order Blind Identifications

• Published in: IEEE access Vol. 7; pp. 11829 - 11843
• Main Authors: Zhang, Chao, Wu, Xiaopei, Zheng, Xi, Yu, Shui
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Biomedical monitoring; blink; Blood volume; blood volume pulse (BVP); Complexity theory; Decision analysis; Driver fatigue; drowsiness detection; Head movement; Heart rate; Heuristic algorithms; Optical measuring instruments; Physiology; second-order blind identification (SOBI); Signal processing algorithms; Vehicles; Video data; Yawn
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2019.2891971

It is well known that blink, yawn, and heart rate changes give clue about a human's mental state, such as drowsiness and fatigue. In this paper, image sequences, as the raw data, are captured from smart phones which serve as non-contact optical sensors. Video streams containing subject's facial region are analyzed to identify the physiological sources that are mixed in each image. We then propose a method to extract blood volume pulse and eye blink and yawn signals as multiple independent sources simultaneously by multi-channel second-order blind identification (SOBI) without any other sophisticated processing, such as eye and mouth localizations. An overall decision is made by analyzing the separated source signals in parallel to determine the driver's driving state. The robustness of the proposed method is tested under various illumination contexts and a variety of head motion modes. Experiments on 15 subjects show that the multi-channel SOBI presents a promising framework to accurately detect drowsiness by merging multi-physiological information in a less complex way.