Unsupervised Subject Detection via Remote PPG

• Published in: IEEE transactions on biomedical engineering Vol. 62; no. 11; pp. 2629 - 2637
• Main Authors: Wang, Wenjin, Stuijk, Sander, de Haan, Gerard
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.11.2015; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Analysis of variance; Biomedical monitoring; Construction; Databases, Factual; Face; Face - anatomy & histology; face detection; Feature extraction; Health care; Human; Humans; Image Processing, Computer-Assisted - methods; Matrix decomposition; Monitoring; object segmentation; photo plethysmography; Photoplethysmography - methods; Pulse - methods; Pulse measurements; Pulse rate; remote sensing; Robustness; Signal Processing, Computer-Assisted; Similarity; Skin; Sparse matrices; Tasks; Variance analysis; remote sensing; object segmentation; photoplethysmography; face detection; Biomedical monitoring
• ISSN: 0018-9294; 1558-2531; 1558-2531
• DOI: 10.1109/TBME.2015.2438321

Subject detection is a crucial task for camera-based remote healthcare monitoring. Most existing methods in subject detection rely on supervised learning of physical appearance features. However, their performances are highly restricted to the pretrained appearance model, while still suffering from the false detection of human-similar objects. In this paper, we propose a novel unsupervised method to detect alive subject in a video using physiological features. Our basic idea originates from the observation that only living skin tissue of a human presents pulse signals, which can be exploited as the feature to distinguish human skin from nonhuman surfaces in videos. The proposed VPS method, named voxel-pulse-spectral, consists of three steps: it 1) creates hierarchical voxels across the video for temporally parallel pulse extraction; 2) builds a similarity matrix for hierarchical pulse signals based on their intrinsic properties; and 3) utilizes incremental sparse matrix decomposition with hierarchical fusion to robustly identify and combine the voxels that correspond to single/multiple subjects. Numerous experiments demonstrate the superior performance of VPS over a state-of-the-art method. On average, VPS improves 82.2% on the precision of skin-region detection; 595.5% on the Pearson correlation, and 542.2% on Bland-Altman agreement of instant pulse rate. ANOVA shows that in all-round evaluations, the improvements of VPS are significant. The proposed method is the first method that uses pulse to robustly detect alive subjects in realistic scenarios, which can be favorably applied for healthcare monitoring.