SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection

• Published in: Frontiers in neuroscience Vol. 16; p. 913027
• Main Authors: Lu, Runnan, Zeng, Ying, Zhang, Rongkai, Yan, Bin, Tong, Li
• Format: Journal Article
• Language: English
• Published: Frontiers Media S.A 02.06.2022
• Subjects: brain-computer interface (BCI); electroencephalography (EEG); graph convolutional neural networks (GCN); Neuroscience; P3 detection; style-based recalibration module (SRM)
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2022.913027

Detecting video-induced P3 is crucial to building the video target detection system based on the brain-computer interface. However, studies have shown that the brain response patterns corresponding to video-induced P3 are dynamic and determined by the interaction of multiple brain regions. This paper proposes a segmentation adaptive spatial-temporal graph convolutional network (SAST-GCN) for P3-based video target detection. To make full use of the dynamic characteristics of the P3 signal data, the data is segmented according to the processing stages of the video-induced P3, and the brain network connections are constructed correspondingly. Then, the spatial-temporal feature of EEG data is extracted by adaptive spatial-temporal graph convolution to discriminate the target and non-target in the video. Especially, a style-based recalibration module is added to select feature maps with higher contributions and increase the feature extraction ability of the network. The experimental results demonstrate the superiority of our proposed model over the baseline methods. Also, the ablation experiments indicate that the segmentation of data to construct the brain connection can effectively improve the recognition performance by reflecting the dynamic connection relationship between EEG channels more accurately.