How Can Physiological Computing Benefit Human-Robot Interaction?

• Published in: Robotics (Basel) Vol. 9; no. 4; pp. 100 - 124
• Main Authors: Roy, Raphaëlle N., Drougard, Nicolas, Gateau, Thibault, Dehais, Frédéric, Chanel, Caroline P. C.
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 2020; MDPI
• Subjects: Automation; Cognitive science; Computer Science; Feedback; Human engineering; Human error; Human performance; Human-Computer Interaction; human-robot interaction; Machine learning; mental state monitoring; Neurophysiology; Neuroscience; Operators; passive BCI; physiological computing; Physiology; Robotics; Robots; State vectors; teleoperation; telerobotics; Mixed-Initiative; Human-Robot Interaction; Passive BCI; Automated Planning; Teleoperation; Mental State Monitoring; Telerobotics; Physiological Computing
• ISSN: 2218-6581; 2218-6581
• DOI: 10.3390/robotics9040100

As systems grow more automatized, the human operator is all too often overlooked. Although human-robot interaction (HRI) can be quite demanding in terms of cognitive resources, the mental states (MS) of the operators are not yet taken into account by existing systems. As humans are no providential agents, this lack can lead to hazardous situations. The growing number of neurophysiology and machine learning tools now allows for efficient operators’ MS monitoring. Sending feedback on MS in a closed-loop solution is therefore at hand. Involving a consistent automated planning technique to handle such a process could be a significant asset. This perspective article was meant to provide the reader with a synthesis of the significant literature with a view to implementing systems that adapt to the operator’s MS to improve human-robot operations’ safety and performance. First of all, the need for this approach is detailed regarding remote operation, an example of HRI. Then, several MS identified as crucial for this type of HRI are defined, along with relevant electrophysiological markers. A focus is made on prime degraded MS linked to time-on-task and task demands, as well as collateral MS linked to system outputs (i.e., feedback and alarms). Lastly, the principle of symbiotic HRI is detailed and one solution is proposed to include the operator state vector into the system using a mixed-initiative decisional framework to drive such an interaction.