Sleep deprivation detected by voice analysis

Using our voice represent an exquisitely intricate act, recruiting a host of cognitive and motor functions. As such, the voice is bound to reflect many aspects of the internal state of the speaker: personality, infections, stress, emotions. Here, we investigate whether sleep deprivation in otherwise...

Full description

Saved in:
Bibliographic Details
Published inPLoS computational biology Vol. 20; no. 2
Main Authors Thoret, Etienne, Andrillon, Thomas, Gauriau, Caroline, Leger, Damien, Pressnitzer, Daniel
Format Journal Article
LanguageEnglish
Published PLOS 05.02.2024
Subjects
Acoustics
Artificial Intelligence
Cognitive science
Computer Science
Human health and pathology
Humanities and Social Sciences
Life Sciences
Mechanics
Neurons and Cognition
Physics
Psychology
Psychology and behavior
Sound
Tissues and Organs
Online AccessGet full text

Cover

More Information
Summary:Using our voice represent an exquisitely intricate act, recruiting a host of cognitive and motor functions. As such, the voice is bound to reflect many aspects of the internal state of the speaker: personality, infections, stress, emotions. Here, we investigate whether sleep deprivation in otherwise normal and healthy persons can be detected through machine-learning analysis of vocal recordings. In contrast to previous approaches, we use fully generic acoustic features, derived from auditory-inspired models of sound processing, together with recently-developed machine learning interpretation techniques. Our results show that sleep deprivation can be accurately detected from generic acoustic features of vocal recordings. Two main different types of features were impacted by sleep deprivation: one related to speech rhythms, the other related to the timbre of the voice. We speculate that these features reflect two distinct physiological processes: the cognitive control of speech production and an inflammatory effect of the vocal apparatus. Crucially, the relative balance of these two effects varied widely for each individual, suggesting that the voice may be used as a "sleep stethoscope" to better understand the variety of idiosyncratic responses to sleep deprivation. Moreover, the method we outline is fully general and could be applied to the future investigation of any type of vocal biomarkers using machine-learning techniques.
ISSN:1553-734X
1553-7358
DOI:10.1101/2022.11.17.516913