Using Smartwatches to Detect Face Touching

• Published in: Sensors (Basel, Switzerland) Vol. 21; no. 19; p. 6528
• Main Authors: Bai, Chen, Chen, Yu-Peng, Wolach, Adam, Anthony, Lisa, Mardini, Mamoun T.
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 30.09.2021; MDPI
• Subjects: accelerometer; Accelerometers; Behavior; Biofeedback; Coronaviruses; COVID-19; Data collection; Disease transmission; face touching; Laboratories; machine learning; Medical research; Pandemics; Respiratory diseases; respiratory illnesses; smartwatch; Smartwatches; Wearable computers
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s21196528

Frequent spontaneous facial self-touches, predominantly during outbreaks, have the theoretical potential to be a mechanism of contracting and transmitting diseases. Despite the recent advent of vaccines, behavioral approaches remain an integral part of reducing the spread of COVID-19 and other respiratory illnesses. The aim of this study was to utilize the functionality and the spread of smartwatches to develop a smartwatch application to identify motion signatures that are mapped accurately to face touching. Participants (n = 10, five women, aged 20–83) performed 10 physical activities classified into face touching (FT) and non-face touching (NFT) categories in a standardized laboratory setting. We developed a smartwatch application on Samsung Galaxy Watch to collect raw accelerometer data from participants. Data features were extracted from consecutive non-overlapping windows varying from 2 to 16 s. We examined the performance of state-of-the-art machine learning methods on face-touching movement recognition (FT vs. NFT) and individual activity recognition (IAR): logistic regression, support vector machine, decision trees, and random forest. While all machine learning models were accurate in recognizing FT categories, logistic regression achieved the best performance across all metrics (accuracy: 0.93 ± 0.08, recall: 0.89 ± 0.16, precision: 0.93 ± 0.08, F1-score: 0.90 ± 0.11, AUC: 0.95 ± 0.07) at the window size of 5 s. IAR models resulted in lower performance, where the random forest classifier achieved the best performance across all metrics (accuracy: 0.70 ± 0.14, recall: 0.70 ± 0.14, precision: 0.70 ± 0.16, F1-score: 0.67 ± 0.15) at the window size of 9 s. In conclusion, wearable devices, powered by machine learning, are effective in detecting facial touches. This is highly significant during respiratory infection outbreaks as it has the potential to limit face touching as a transmission vector.