Identification of the Psychophysiological State of the User Based on Hidden Monitoring in Computer Systems

• Published in: Scientific and technical information processing Vol. 45; no. 6; pp. 398 - 410
• Main Authors: Vasilyev, V. I., Sulavko, A. E., Borisov, R. V., Zhumazhanova, S. S.
• Format: Journal Article
• Language: English
• Published: Moscow Pleiades Publishing 01.12.2018
• Subjects: Computer Science; Computer Systems Organization and Communication Networks; keystroke dynamics; voice attributes; the option of working with a computer mouse; identification of psychophysiological conditions; biometric feature
• ISSN: 0147-6882; 1934-8118
• DOI: 10.3103/S0147688218060096

It is found that the features of the voice, keystroke dynamics and pattern of a subject’s use of a computer mouse contain the following information about the psychophysiological state of the operator: normal, fatigue, intoxication, excited, and relaxed (sleepy). Voice features are the best for identifying fatigue or a sleepy state of a speaker. Keystroke dynamics, aside from these states, have features that characterize the normal state of the operator. Some features of working with a computer mouse contain information about the states of intoxication and sleepiness. This experiment on state identification was based on Bayes strategies and the neural network approach; the best result was a 5.9% error in determining the state when monitoring a subject for no more than 100 s.