Posthoc Interpretability of Neural Responses by Grouping Subject Motor Imagery Skills Using CNN-Based Connectivity

• Published in: Sensors (Basel, Switzerland) Vol. 23; no. 5; p. 2750
• Main Authors: Collazos-Huertas, Diego Fabian, Álvarez-Meza, Andrés Marino, Cárdenas-Peña, David Augusto, Castaño-Duque, Germán Albeiro, Castellanos-Domínguez, César Germán
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 01.03.2023; MDPI
• Subjects: Algorithms; Brain - physiology; Brain research; Brain-Computer Interfaces; class activation maps; Deep learning; EEG Network; Electroencephalography; Electroencephalography - methods; functional connectivity; Humans; Imagery, Psychotherapy; Information literacy; Machine learning; Motor ability; motor imagery; Motor Skills; Neural networks; Neural Networks, Computer; Physiology; Sensors; Colombia; motor imagery; functional connectivity; motor skills; class activation maps; EEG Network
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23052750

Motor Imagery (MI) refers to imagining the mental representation of motor movements without overt motor activity, enhancing physical action execution and neural plasticity with potential applications in medical and professional fields like rehabilitation and education. Currently, the most promising approach for implementing the MI paradigm is the Brain-Computer Interface (BCI), which uses Electroencephalogram (EEG) sensors to detect brain activity. However, MI-BCI control depends on a synergy between user skills and EEG signal analysis. Thus, decoding brain neural responses recorded by scalp electrodes poses still challenging due to substantial limitations, such as non-stationarity and poor spatial resolution. Also, an estimated third of people need more skills to accurately perform MI tasks, leading to underperforming MI-BCI systems. As a strategy to deal with BCI-Inefficiency, this study identifies subjects with poor motor performance at the early stages of BCI training by assessing and interpreting the neural responses elicited by MI across the evaluated subject set. Using connectivity features extracted from class activation maps, we propose a Convolutional Neural Network-based framework for learning relevant information from high-dimensional dynamical data to distinguish between MI tasks while preserving the post-hoc interpretability of neural responses. Two approaches deal with inter/intra-subject variability of MI EEG data: (a) Extracting functional connectivity from spatiotemporal class activation maps through a novel kernel-based cross-spectral distribution estimator, (b) Clustering the subjects according to their achieved classifier accuracy, aiming to find common and discriminative patterns of motor skills. According to the validation results obtained on a bi-class database, an average accuracy enhancement of 10% is achieved compared to the baseline EEGNet approach, reducing the number of “poor skill” subjects from 40% to 20%. Overall, the proposed method can be used to help explain brain neural responses even in subjects with deficient MI skills, who have neural responses with high variability and poor EEG-BCI performance.