Combined Method Comprising Low Burden Physiological Measurements with Dry Electrodes and Machine Learning for Classification of Visually Induced Motion Sickness in Remote-Controlled Excavator

• Published in: Sensors (Basel, Switzerland) Vol. 24; no. 19; p. 6465
• Main Authors: Yoshioka, Naohito, Takeuchi, Hiroki, Shu, Yuzhuo, Okamatsu, Taro, Araki, Nobuyuki, Kamakura, Yoshiyuki, Ohsuga, Mieko
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 07.10.2024; MDPI
• Subjects: Adult; Construction equipment industry; Construction Industry; cybersickness; Earthmoving equipment; Electrocardiography; Electrodes; Electroencephalography; Excavating machinery; Experiments; Humans; low-burden physiological measurement; Machine Learning; Male; Methods; Motion sickness; Motion Sickness - physiopathology; Nervous system; physiological measurement; Physiology; Questionnaires; Ratings & rankings; remote control; ROC Curve; visually induced motion sickness; Young Adult; Japan; cybersickness; low-burden physiological measurement; visually induced motion sickness; remote control; machine learning; physiological measurement; operator condition
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s24196465

The construction industry is actively developing remote-controlled excavators to address labor shortages and improve work safety. However, visually induced motion sickness (VIMS) remains a concern in the remote operation of construction machinery. To predict the occurrence and severity of VIMS, we developed a prototype system that acquires multiple physiological signals with different mechanisms under a low burden and detects VIMS from the collected data. Signals during VIMS were recorded from nine healthy adult males operating excavator simulators equipped with multiple displays and a head-mounted display. Light gradient-boosting machine-based VIMS detection binary classification models were constructed using approximately 30,000 s of time-series data, comprising 23 features derived from the physiological signals. These models were validated using leave-one-out cross-validation on seven participants who experienced severe VIMS and evaluated through area under the curve (AUC) scores. The mean receiver operating characteristic curve AUC score was 0.84, and the mean precision-recall curve AUC score was 0.71. All features were incorporated into the models, with saccade frequency and skin conductance response identified as particularly important. These trends aligned with subjective assessments of VIMS severity. This study contributes to advancing the use of remote-controlled machinery by addressing a critical challenge to operator performance and safety.