Towards Decoding Selective Attention from Single-Trial EEG Data in Cochlear Implant users based on Deep Neural Networks

• Published in: Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) pp. 8708 - 8712
• Main Authors: Nogueira, Waldo, Dolhopiatenko, Hanna
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2020
• Subjects: Brain modeling; Cochlear implant; Cochlear implants; Decoding; deep neural network; EEG; Electroencephalography; Neural networks; selective attention; Signal processing; Speech enhancement
• ISSN: 2379-190X
• DOI: 10.1109/ICASSP40776.2020.9054021

Electroencephalography (EEG) data can be used to decode an attended speech source in normal-hearing (NH) listeners. One application of this technology consists of identifying the target speaker in a cocktail party-like scenario and activate speech enhancement algorithms in cochlear implants (CIs). It has been shown that in CIs it is possible to decode selective attention, although the worse spectral resolution and the electrical artifacts introduced by a CI decrease the accuracy of linear decoders in comparison to NH subjects. The goal of this work was to investigate the use of non-linear models based on deep neural networks (DNNs) to improve the selective attention decoding accuracy in CI users. The hypothesis is that a non-linear decoder may be able to better separate the electrical artifact from the neural responses. Results confirm the feasibility to decode selective attention by means of single-trial EEG data in NH and CI users using a high-density EEG. Moreover, we show that a simple DNN architecture that directly classifies the locus of attention based on the EEG and a mixture of the incoming speech stream envelopes can be used to decode selective attention in CI users.