Predicting Perceived Exhaustion in Rehabilitation Exercises Using Facial Action Units

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 17; p. 6524
• Main Authors: Kreis, Christopher, Aguirre, Andres, Cifuentes, Carlos A, Munera, Marcela, Jiménez, Mario F, Schneider, Sebastian
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 30.08.2022; MDPI
• Subjects: affective computing; Blood pressure; Cameras; Chronic diseases; Data recording; Datasets; Exercise; facial action coding systems; Feedback; Heart rate; Muscle fatigue; Oxygen saturation; Patients; physical activity recognition; Physical exercise; Physiology; Rehabilitation; Signs and symptoms; Sports training; Strength training; Wearable technology
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22176524

Physical exercise has become an essential tool for treating various non-communicable diseases (also known as chronic diseases). Due to this, physical exercise allows to counter different symptoms and reduce some risk of death factors without medication. A solution to support people in doing exercises is to use artificial systems that monitor their exercise progress. While one crucial aspect is to monitor the correct physical motions for rehabilitative exercise, another essential element is to give encouraging feedback during workouts. A coaching system can track a user’s exhaustion and give motivating feedback accordingly to boost exercise adherence. For this purpose, this research investigates whether it is possible to predict the subjective exhaustion level based on non-invasive and non-wearable technology. A novel data set was recorded with the facial record as the primary predictor and individual exhaustion levels as the predicted variable. 60 participants (30 male, 30 female) took part in the data recording. 17 facial action units (AU) were extracted as predictor variables for the perceived subjective exhaustion measured using the BORG scale. Using the predictor and the target variables, several regression and classification methods were evaluated aiming to predict exhaustion. The results showed that the decision tree and support vector methods provide reasonable prediction results. The limitation of the results, depending on participants being in the training data set and subjective variables (e.g., participants smiling during the exercises) were further discussed.