Classification of hand movements from EEG using a FusionNet based LSTM network

• Published in: Journal of neural engineering Vol. 21; no. 6; pp. 66013 - 66027
• Main Authors: Ji, Li, Yi, Leiye, Huang, Chaohang, Li, Haiwei, Han, Wenjie, Zhang, Ningning
• Format: Journal Article
• Language: English
• Published: England IOP Publishing 01.12.2024
• Subjects: BCI; CNN; deep learning; EEG; hand movements; LSTM; deep learning; BCI; CNN; LSTM; hand movements; EEG
• ISSN: 1741-2560; 1741-2552; 1741-2552
• DOI: 10.1088/1741-2552/ad905d

Objective . Accurate classification of electroencephalogram (EEG) signals is crucial for advancing brain–computer interface (BCI) technology. However, current methods face significant challenges in classifying hand movement EEG signals, including effective spatial feature extraction, capturing temporal dependencies, and representing underlying signal dynamics. Approach . This paper introduces a novel multi-model fusion approach, FusionNet-Long Short-Term Memory (LSTM), designed to address these issues. Specifically, it integrates Convolutional Neural Networks for spatial feature extraction, Gated Recurrent Units and LSTM networks for capturing temporal dependencies, and Autoregressive (AR) models for representing signal dynamics. Main results . Compared to single models and state-of-the-art methods, this fusion approach demonstrates substantial improvements in classification accuracy. Experimental results show that the proposed model achieves an accuracy of 87.1% in cross-subject data classification and 99.1% in within-subject data classification. Additionally, Gradient Boosting Trees were employed to evaluate the significance of various EEG features to the model. Significance . This study highlights the advantages of integrating multiple models and introduces a superior classification model, which is pivotal for the advancement of BCI systems.