Application of Speech on Stress Recognition with Neural Network in Nuclear Power Plant

Human failures occur in nuclear power plants when operators are under acute stress. Therefore, an automatic stressed recognition system should be developed for nuclear power work. Previous studies on the prediction of stress are limited because of their reliance on subjective ratings and contact phy...

Full description

Saved in:
Bibliographic Details
Published inApplied sciences Vol. 13; no. 2; p. 779
Main Authors Chen, Jiaqi, Wu, Bohan, Xie, Kaijie, Ma, Shu, Yang, Zhen, Shen, Yi
Format Journal Article
LanguageEnglish
Published Basel MDPI AG 01.01.2023
Subjects
Anxiety
Cognitive ability
Cognitive tasks
Contact stresses
electrodermal activity
Emotions
Experiments
Heart rate
Human error
Machine learning
Memory
Nervous system
Neural networks
nuclear power
Nuclear power plants
Operators
Physiology
Predictions
Psychology
Speech
Speech recognition
Stress
Stress state
Verbal communication
Voice recognition
Workloads
Online AccessGet full text

Cover

More Information
Summary:Human failures occur in nuclear power plants when operators are under acute stress. Therefore, an automatic stressed recognition system should be developed for nuclear power work. Previous studies on the prediction of stress are limited because of their reliance on subjective ratings and contact physiological measurement. To solve this problem, we developed a non-intrusive way by using voice features to detect stress. We aim to build a system that can estimate the level of stress from speech which may be applied to nuclear power plants where operators engage in regular verbal communication as part of their duties. In this study, we collected voice recordings from 34 participants during a simulated nuclear plant power task in a time-limited situation that requires high cognitive resources. Mel frequency cepstrum coefficients (MFCCs) were extracted from stressed voice samples and the neural network model was used to assess stress levels continuously. The experimental results showed that voice features can provide satisfactory predictions of the stress state. Mean relative errors of prediction are possible within approximately 5%. We discuss the implications of the use of voice as a minimally intrusive means for monitoring the effects of stress on cognitive performance in practical applications.
ISSN:2076-3417
2076-3417
DOI:10.3390/app13020779