Multiclass Classification of Imagined Speech Vowels and Words of Electroencephalography Signals Using Deep Learning

• Published in: Advances in human-computer interaction Vol. 2022; pp. 1 - 10
• Main Authors: Mahapatra, Nrushingh Charan, Bhuyan, Prachet
• Format: Journal Article
• Language: English
• Published: New York Hindawi 20.07.2022; John Wiley & Sons, Inc; Wiley
• Subjects: Accuracy; Analysis; Artificial neural networks; Brain; Brain research; Classification; Communication; Computer applications; Deep learning; Discrete Wavelet Transform; Discriminant analysis; EEG; Electroencephalography; Eye movements; Human-computer interface; Implants; Information retrieval; Machine learning; Multichannel communication; Muscle function; Neural networks; Performance enhancement; Signal processing; Speech; Support vector machines; Verbal communication; Vowels; Words (language); New York
• ISSN: 1687-5893; 1687-5907
• DOI: 10.1155/2022/1374880

The paper’s emphasis is on the imagined speech decoding of electroencephalography (EEG) neural signals of individuals in accordance with the expansion of the brain-computer interface to encompass individuals with speech problems encountering communication challenges. Decoding an individual’s imagined speech from nonstationary and nonlinear EEG neural signals is a complex task. Related research work in the field of imagined speech has revealed that imagined speech decoding performance and accuracy require attention to further improve. The evolution of deep learning technology increases the likelihood of decoding imagined speech from EEG signals with enhanced performance. We proposed a novel supervised deep learning model that combined the temporal convolutional networks and the convolutional neural networks with the intent of retrieving information from the EEG signals. The experiment was carried out using an open-access dataset of fifteen subjects’ imagined speech multichannel signals of vowels and words. The raw multichannel EEG signals of multiple subjects were processed using discrete wavelet transformation technique. The model was trained and evaluated using the preprocessed signals, and the model hyperparameters were adjusted to achieve higher accuracy in the classification of imagined speech. The experiment results demonstrated that the multiclass imagined speech classification of the proposed model exhibited a higher overall accuracy of 0.9649 and a classification error rate of 0.0350. The results of the study indicate that individuals with speech difficulties might well be able to leverage a noninvasive EEG-based imagined speech brain-computer interface system as one of the long-term alternative artificial verbal communication mediums.