Deep Multiview Module Adaption Transfer Network for Subject-Specific EEG Recognition

• Published in: IEEE transaction on neural networks and learning systems Vol. 36; no. 2; pp. 2917 - 2930
• Main Authors: Cui, Weigang, Xiang, Yansong, Wang, Yifan, Yu, Tao, Liao, Xiao-Feng, Hu, Bin, Li, Yang
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.02.2025
• Subjects: Algorithms; Brain modeling; Convolutional neural networks; Databases, Factual; Deep Learning; Electroencephalogram (EEG) recognition; Electroencephalography; Electroencephalography - methods; Feature extraction; Humans; Imagination - physiology; module adaption; multiview; Neural Networks, Computer; Pattern Recognition, Automated - methods; Seizures - diagnosis; Seizures - physiopathology; Target recognition; Task analysis; Transfer learning
• ISSN: 2162-237X; 2162-2388; 2162-2388
• DOI: 10.1109/TNNLS.2024.3350085

Transfer learning is one of the popular methods to solve the problem of insufficient data in subject-specific electroencephalogram (EEG) recognition tasks. However, most existing approaches ignore the difference between subjects and transfer the same feature representations from source domain to different target domains, resulting in poor transfer performance. To address this issue, we propose a novel subject-specific EEG recognition method named deep multiview module adaption transfer (DMV-MAT) network. First, we design a universal deep multiview (DMV) network to generate different types of discriminative features from multiple perspectives, which improves the generalization performance by extensive feature sets. Second, module adaption transfer (MAT) is designed to evaluate each module by the feature distributions of source and target samples, which can generate an optimal weight sharing strategy for each target subject and promote the model to learn domain-invariant and domain-specific features simultaneously. We conduct extensive experiments in two EEG recognition tasks, i.e., motor imagery (MI) and seizure prediction, on four datasets. Experimental results demonstrate that the proposed method achieves promising performance compared with the state-of-the-art methods, indicating a feasible solution for subject-specific EEG recognition tasks. Implementation codes are available at https://github.com/YangLibuaa/DMV-MAT .