Deep Adversarial Domain Adaptation With Few-Shot Learning for Motor-Imagery Brain-Computer Interface

• Published in: IEEE access Vol. 10; pp. 57255 - 57265
• Main Authors: Phunruangsakao, Chatrin, Achanccaray, David, Hayashibe, Mitsuhiro
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation; Brain modeling; Brain-computer interface; Brain-computer interfaces; Classifiers; Convolution; Data mining; domain adaptation; Electroencephalography; Feature extraction; few-shot learning; Human-computer interface; Learning; motor imagery; representation learning; Statistical methods; Training
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2022.3178100

Electroencephalography (EEG) is the most prevalent signal acquisition technique for brain-computer interface (BCI). However, the statistical distribution of EEG data varies across subjects and sessions, resulting in poor generalization of the domain-specific classifier. Although the collection of a large number of recordings may alleviate this issue, it is often impractical and not user-friendly. This study proposes the integration of deep domain adaptation with few-shot learning to address the challenge by leveraging the knowledge from multiple source subjects to enhance the performance of a single target subject. The framework incorporated 3 modules: a feature extractor, domain discriminator, and classifier. The feature extractor utilized the available labeled samples with supervised contrastive loss to map the discriminate features onto a deep representation space, where the features from the same class were more similar than those from different classes. The domain discriminator was used to reduce domain drift, through adversarial training. The classifier predicted the user motor intention, based on EEG features. The framework was extensively evaluated through the BCI Competition IV Datasets 2a and 2b. The results of this study indicate that the framework is capable of enhancing the BCI performance and potentially decreases the calibration effort compared to the traditional approach, but the major limitation of this method is that it requires meticulous selection of source subjects.