Transfer Learning with Optimal Transportation and Frequency Mixup for EEG-based Motor Imagery Recognition

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 30; p. 1
• Main Authors: Chen, Peiyin, Wang, He, Sun, Xinlin, Li, Haoyu, Grebogi, Celso, Gao, Zhongke
• Format: Journal Article
• Language: English
• Published: New York IEEE 2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation; Adaptation models; Benchmarks; Brain modeling; brain-computer interface (BCI); EEG; electroencephalogram (EEG); Electroencephalography; Embedding; Feature extraction; Frequency-domain analysis; Human-computer interface; Imagery; Interfaces; Learning; Mathematical analysis; Mental task performance; Motor skill learning; optimal transportation; Transfer learning; Transportation
• ISSN: 1534-4320; 1558-0210; 1558-0210
• DOI: 10.1109/TNSRE.2022.3211881

Electroencephalography-based Brain Computer Interfaces (BCIs) invariably have a degenerate performance due to the considerable individual variability. To address this problem, we develop a novel domain adaptation method with optimal transport and frequency mixup for cross-subject transfer learning in motor imagery BCIs. Specifically, the preprocessed EEG signals from source and target domain are mapped into latent space with an embedding module, where the representation distributions and label distributions across domains have a large discrepancy. We assume that there exists a non-linear coupling matrix between both domains, which can be utilized to estimate the distance of joint distributions for different domains. Depending on the optimal transport, the Wasserstein distance between source and target domains is minimized, yielding the alignment of joint distributions. Moreover, a new mixup strategy is also introduced to generalize the model, where the inputs trials are mixed in frequency domain rather than in raw space. The extensive experiments on three evaluation benchmarks are conducted to validate the proposed framework. All the results demonstrate that our method achieves a superior performance than previous state-of-the-art domain adaptation approaches.