Design and Implementation of a Noncontact Sleep Monitoring System Using Infrared Cameras and Motion Sensor

• Published in: IEEE transactions on instrumentation and measurement Vol. 67; no. 7; pp. 1555 - 1563
• Main Authors: Deng, Fei, Dong, Jianwu, Wang, Xiangyu, Fang, Ying, Liu, Yu, Yu, Zhaofei, Liu, Jing, Chen, Feng
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.07.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Biomedical monitoring; Body posture; Breathing; Cameras; Classification; Disorders; Feasibility studies; Head; Human motion; Infrared cameras; Infrared detectors; Machine learning; Magnetic heads; Monitoring; Monitoring systems; motion analysis; Motion sensors; Occlusion; Posture; Respiration; Sleep; Sleep apnea; Sleep disorders; sleep monitoring; Template matching; Tracking
• ISSN: 0018-9456; 1557-9662
• DOI: 10.1109/TIM.2017.2779358

Quality sleep is essential for human health. Recent developments in sleep monitoring techniques show great promise of detecting sleep disorders and improving sleep quality. Two important indicators for sleep disorders are breathing and posture, but existing methods deal with them separately, and hardly any effort has been devoted to head posture. In this paper, we present the design and implementation of a novel sleep monitoring system that simultaneously analyzes respiration, head posture, and body posture. The system consists solely of cost-effective vision-based devices, operating in a quiet and noncontact way with a little disturbance to natural sleep. Specifically, we use an infrared camera to record the sleep process. From the infrared video, the region of breathing movement is automatically determined and the intensity estimated, yielding a waveform indicating respiratory rhythms. Five additional infrared cameras are employed to capture the subject's face from different orientations, and we exploit template matching to perform head tracking. A Kinect motion sensor is also utilized to obtain skeleton description of body posture that is robust to self-occlusion, and after noise being filtered, we apply machine learning techniques for body posture classification. Experimental results show that elementary breathing and posture analysis are feasible based on the information acquired by the proposed system, and high accuracy can be achieved: 96% in recognizing abnormal breathing and body movements, 87.6% in head tracking, and over 90% in classifying most body postures.