An Explainable and Generalizable Recurrent Neural Network Approach for Differentiating Human Brain States on EEG Dataset

• Published in: IEEE transaction on neural networks and learning systems Vol. 35; no. 6; pp. 7339 - 7350
• Main Authors: Zhang, Shu, Wu, Lin, Yu, Sigang, Shi, Enze, Qiang, Ning, Gao, Huan, Zhao, Jingyi, Zhao, Shijie
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.06.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Biochips; Brain; Brain modeling; Classification; Computer applications; Data models; Deep learning; Differentiating brain states; EEG; electroencephalogram (EEG); Electroencephalography; Feature extraction; Human-computer interface; Implants; Machine learning; Modules; Multilayers; multiple random fragment search (MRFS); Neural networks; Nonhomogeneous media; recurrent neural network (RNN); Recurrent neural networks; Task analysis; Time series analysis
• ISSN: 2162-237X; 2162-2388
• DOI: 10.1109/TNNLS.2022.3214225

Electroencephalogram (EEG) is one of the most widely used brain computer interface (BCI) approaches. Despite the success of existing EEG approaches in brain state recognition studies, it is still challenging to differentiate brain states via explainable and generalizable deep learning approaches. In other words, how to explore meaningful and distinguishing features and how to overcome the huge variability and overfitting problem still need to be further studied. To alleviate these challenges, in this work, a multiple random fragment search-based multilayer recurrent neural network (MRFS-MRNN) is proposed to improve the differentiating performance and explore meaningful patterns. Specifically, an explainable MRNN module is proposed to capture the temporal dependences preserved in EEG time series. Besides, a MRFS module is designed to cut multiple random fragments from the entire EEG signal time course to improve the effectiveness of brain state differentiating ability. MRFS-MRNN is concatenatedto effectively overcome the huge variabilities and overfitting problems. Experiment results demonstrate that the proposed MRFS-MRNN model not only has excellent differentiating performance, but also has good explanation and generalization ability. The classification accuracies reach as high as 95.18% for binary classification and 89.19% for four-category classification on the individual level. Similarly, 95.53% and 85.84% classification accuracies are obtained for the binary and four-category classification on the group level. What's more, 94.28% and 85.43% classification accuracies of binary and four-category classifications are achieved for predicting brand new subjects. The experiment results showed that the proposed method outperformed other state-of-the-art (SOTA) models on the same underlying data and improved the explanation and generalization ability.