Mutual Information-Driven Subject-Invariant and Class-Relevant Deep Representation Learning in BCI

• Published in: IEEE transaction on neural networks and learning systems Vol. 34; no. 2; pp. 739 - 749
• Main Authors: Jeon, Eunjin, Ko, Wonjun, Yoon, Jee Seok, Suk, Heung-Il
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.02.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Ablation; Adaptation; Algorithms; Brain modeling; Brain-Computer Interfaces; Brain–computer interface (BCI); Calibration; Decoding; Deep learning; domain adaptation; Domains; EEG; electroencephalogram; Electroencephalography; Electroencephalography - methods; Feature extraction; Human-computer interface; Humans; Information theory; Invariants; Machine Learning; motor imagery; Mutual information; Neural Networks, Computer; Representations; subject-independent; Training; Transfer learning
• DOI: 10.1109/TNNLS.2021.3100583
• ISSN: 2162-237X; 2162-2388

In recent years, deep learning-based feature representation methods have shown a promising impact on electroencephalography (EEG)-based brain-computer interface (BCI). Nonetheless, owing to high intra- and inter-subject variabilities, many studies on decoding EEG were designed in a subject-specific manner by using calibration samples, with no concern of its practical use, hampered by time-consuming steps and a large data requirement. To this end, recent studies adopted a transfer learning strategy, especially domain adaptation techniques. Among those, we have witnessed the potential of adversarial learning-based transfer learning in BCIs. In the meantime, it is known that adversarial learning-based domain adaptation methods are prone to negative transfer that disrupts learning generalized feature representations, applicable to diverse domains, for example, subjects or sessions in BCIs. In this article, we propose a novel framework that learns class-relevant and subject-invariant feature representations in an information-theoretic manner, without using adversarial learning. To be specific, we devise two operational components in a deep network that explicitly estimate mutual information between feature representations: 1) to decompose features in an intermediate layer into class-relevant and class-irrelevant ones and 2) to enrich class-discriminative feature representation. On two large EEG datasets, we validated the effectiveness of our proposed framework by comparing with several comparative methods in performance. Furthermore, we conducted rigorous analyses by performing an ablation study in regard to the components in our network, explaining our model's decision on input EEG signals via layer-wise relevance propagation, and visualizing the distribution of learned features via t-SNE.