Learning Subject-Generalized Topographical EEG Embeddings Using Deep Variational Autoencoders and Domain-Adversarial Regularization

• Published in: Sensors Vol. 21; no. 5; p. 1792
• Main Authors: Hagad, Juan, Kimura, Tsukasa, Fukui, Ken-ichi, Numao, Masayuki
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 04.03.2021; MDPI
• Subjects: Chemical technology; domain adversarial network; domain generalization; Electroencephalography; emotion modeling; Emotions; Humans; Neural Networks, Computer; subject independence; TP1-1185; variational autoencoder; electroencephalography; emotion modeling; domain adversarial network; variational autoencoder; domain generalization; subject independence
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s21051792

Two of the biggest challenges in building models for detecting emotions from electroencephalography (EEG) devices are the relatively small amount of labeled samples and the strong variability of signal feature distributions between different subjects. In this study, we propose a context-generalized model that tackles the data constraints and subject variability simultaneously using a deep neural network architecture optimized for normally distributed subject-independent feature embeddings. Variational autoencoders (VAEs) at the input level allow the lower feature layers of the model to be trained on both labeled and unlabeled samples, maximizing the use of the limited data resources. Meanwhile, variational regularization encourages the model to learn Gaussian-distributed feature embeddings, resulting in robustness to small dataset imbalances. Subject-adversarial regularization applied to the bi-lateral features further enforces subject-independence on the final feature embedding used for emotion classification. The results from subject-independent performance experiments on the SEED and DEAP EEG-emotion datasets show that our model generalizes better across subjects than other state-of-the-art feature embeddings when paired with deep learning classifiers. Furthermore, qualitative analysis of the embedding space reveals that our proposed subject-invariant bi-lateral variational domain adversarial neural network (BiVDANN) architecture may improve the subject-independent performance by discovering normally distributed features.