Research on recognition of O-MI based on CNN combined with SST and LSTM

• Published in: Optoelectronics letters Vol. 18; no. 9; pp. 566 - 571
• Main Authors: Li, Penghai, Liu, Cong
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.09.2022; Springer Nature B.V
• Subjects: Algorithms; Artificial neural networks; Classification; Datasets; Discrete Wavelet Transform; Feature extraction; Human-computer interface; Lasers; Optical Devices; Optics; Photonics; Physics; Physics and Astronomy; Power spectral density; Recognition; Rehabilitation; Wavelet transforms; A
• ISSN: 1673-1905; 1993-5013
• DOI: 10.1007/s11801-022-2054-1

Recognition algorithms have been widely used in brain computer interface (BCI) for neural paradigms classification. To improve the classification and recognition effect of motor imagery with motor observation (O-MI) in BCI rehabilitation technology, this paper explores the function of convolutional neural network (CNN) combined with synchrosqueezed wavelet transform (SST) and long short-term memory (LSTM) in the recognition and classification of neural activities in the brain motor area. Combining the advantages of SST in signal feature extraction in the pretreatment stage and the ability of LSTM network in time series information modeling, the purpose is to make up for CNN’s shortcomings in both aspects. This paper verifies the algorithm on the self-collected O-MI experimental datasets and the public datasets (BCI competition IV datasets 2a). The results show that the composite CNN algorithm incorporating SST and LSTM achieves higher classification accuracy than classic algorithms and the similar new method which is CNN combined with discrete wavelet transform (DWT) and power spectral density (PSD), so it is convenient for practical application in O-MI BCI system.