A shallow mirror transformer for subject-independent motor imagery BCI

• Published in: Computers in biology and medicine Vol. 164; p. 107254
• Main Authors: Luo, Jing, Wang, Yaojie, Xia, Shuxiang, Lu, Na, Ren, Xiaoyong, Shi, Zhenghao, Hei, Xinhong
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.09.2023; Elsevier Limited
• Subjects: Classification; Datasets; EEG; Electroencephalography; Image classification; Internal Medicine; Machine learning; Mental task performance; Motor task performance; Movement disorders; Other; Receptive field; Rehabilitation; Segments; Transformers; Brain–computer interfaces (BCI); Motor imagery (MI); Multihead self-attention; Subject-independent BCI
• ISSN: 0010-4825; 1879-0534; 1879-0534
• DOI: 10.1016/j.compbiomed.2023.107254

Motor imagery BCI plays an increasingly important role in motor disorders rehabilitation. However, the position and duration of the discriminative segment in an EEG trial vary from subject to subject and even trial to trial, and this leads to poor performance of subject-independent motor imagery classification. Thus, determining how to detect and utilize the discriminative signal segments is crucial for improving the performance of subject-independent motor imagery BCI. In this paper, a shallow mirror transformer is proposed for subject-independent motor imagery EEG classification. Specifically, a multihead self-attention layer with a global receptive field is employed to detect and utilize the discriminative segment from the entire input EEG trial. Furthermore, the mirror EEG signal and the mirror network structure are constructed to improve the classification precision based on ensemble learning. Finally, the subject-independent setup was used to evaluate the shallow mirror transformer on motor imagery EEG signals from subjects existing in the training set and new subjects. The experiments results on BCI Competition IV datasets 2a and 2b and the OpenBMI dataset demonstrated the promising effectiveness of the proposed shallow mirror transformer. The shallow mirror transformer obtained average accuracies of 74.48% and 76.1% for new subjects and existing subjects, respectively, which were highest among the compared state-of-the-art methods. In addition, visualization of the attention score showed the ability of discriminative EEG segment detection. This paper demonstrated that multihead self-attention is effective in capturing global EEG signal information in motor imagery classification. This study provides an effective model based on a multihead self-attention layer for subject-independent motor imagery-based BCIs. To the best of our knowledge, this is the shallowest transformer model available, in which a small number of parameters promotes the performance in motor imagery EEG classification for such a small sample problem. •The global receptive field of the self-attention module is used to detect and utilize the discriminative EEG segment.•The mirror EEG trial and mirror network structures are applied to improve the precision of EEG recognition.•The SMT model showed excellent performance compared with the SOTAs in the subject-independent MI-BCI.•Visualization of the attention score showed the ability of discriminative EEG segment detection.•To the best of our knowledge, this is the shallowest transformer model existing.