Quantifying the Rating Performance of Ambiguous and Unambiguous Facial Expression Perceptions Under Conditions of Stress by Using Wearable Sensors

• Published in: HCI International 2022 - Late Breaking Papers. Design, User Experience and Interaction pp. 519 - 529
• Main Authors: Binter, Jakub, Boschetti, Silvia, Hladký, Tomáš, Prossinger, Hermann, Wells, Timothy Jason, Jílková, Jiřina, Říha, Daniel
• Format: Book Chapter
• Language: English
• Published: Cham Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: ARMA time series; Bayesian likelihood; BVP; Emotion perception; Fear; Maximum likelihood distributions; Pain; Pleasure; Stress; Wearables
• ISBN: 9783031176142; 3031176146
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-031-17615-9_36

Background: In real-world scenarios humans perceive the world contextually, relying on previous information to modify their responses. During interactions with a machine, missing contexts may decrease the accuracy of judgements. In the realm of human-computer interactions (HCI), relatively easy tasks as controls may not be relevant. To evaluate the impact of stress we increased the cortisol level by the safe but reliable procedure Cold Pressor Task. We used five stimuli represented by facial expressions: ‘neutral’, ‘laughter’, ‘fear’, ‘pain’, and ‘pleasure’. Aim: We intend to find out how the responses to stimuli are altered by stress and statistically quantify the BVP (Blood Volume Pulse) signals. Materials: 27 raters rated these five stimuli presented by 5 actors and 5 actresses, while BVP was being registered. Methods: Each physiological response was a six-second time series after the rater rated the stimulus. A nontrivial model includes lag dependencies on either previous states or previous noise. The simplest models would be ARMAp,q\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ARMA\left( {p,q} \right)$$\end{document} models with to-be-determined parameters φ1,…φp\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varphi_{1} , \, \ldots \,\varphi_{p}$$\end{document} and θ1,…θq\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta_{1} ,\, \ldots \, \theta_{q}$$\end{document}. Inferences: In this study, we find that the wearables’ sampling for six seconds cannot separate signal from noise significantly. Only one response was found to be significantly affected by the condition of stress: the perception of fear.