Enhancing Deep-Learning Classification for Remote Motor Imagery Rehabilitation Using Multi-Subject Transfer Learning in IoT Environment

• Published in: Sensors (Basel, Switzerland) Vol. 24; no. 24; p. 8127
• Main Authors: Khabti, Joharah, AlAhmadi, Saad, Soudani, Adel
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 19.12.2024
• Subjects: Accuracy; Brain research; Brain-Computer Interfaces; brain–computer interface (BCI); Classification; Cloud computing; Communication; Cultural differences; Data processing; Deep Learning; deep learning (DL); Edge computing; Efficiency; electroencephalogram (EEG); Electroencephalography - methods; Humans; Internet of Things; internet of things (IoT); Memory; motor imagery (MI); Neural networks; Rehabilitation; Sensors; Signal Processing, Computer-Assisted; transfer learning (TL); brain–computer interface (BCI); internet of things (IoT); motor imagery (MI); transfer learning (TL); edge computing; electroencephalogram (EEG); deep learning (DL)
• DOI: 10.3390/s24248127
• ISSN: 1424-8220

One of the most promising applications for electroencephalogram (EEG)-based brain–computer interfaces (BCIs) is motor rehabilitation through motor imagery (MI) tasks. However, current MI training requires physical attendance, while remote MI training can be applied anywhere, facilitating flexible rehabilitation. Providing remote MI training raises challenges to ensuring an accurate recognition of MI tasks by healthcare providers, in addition to managing computation and communication costs. The MI tasks are recognized through EEG signal processing and classification, which can drain sensor energy due to the complexity of the data and the presence of redundant information, often influenced by subject-dependent factors. To address these challenges, we propose in this paper a multi-subject transfer-learning approach for an efficient MI training framework in remote rehabilitation within an IoT environment. For efficient implementation, we propose an IoT architecture that includes cloud/edge computing as a solution to enhance the system’s efficiency and reduce the use of network resources. Furthermore, deep-learning classification with and without channel selection is applied in the cloud, while multi-subject transfer-learning classification is utilized at the edge node. Various transfer-learning strategies, including different epochs, freezing layers, and data divisions, were employed to improve accuracy and efficiency. To validate this framework, we used the BCI IV 2a dataset, focusing on subjects 7, 8, and 9 as targets. The results demonstrated that our approach significantly enhanced the average accuracy in both multi-subject and single-subject transfer-learning classification. In three-subject transfer-learning classification, the FCNNA model achieved up to 79.77% accuracy without channel selection and 76.90% with channel selection. For two-subject and single-subject transfer learning, the application of transfer learning improved the average accuracy by up to 6.55% and 12.19%, respectively, compared to classification without transfer learning. This framework offers a promising solution for remote MI rehabilitation, providing both accurate task recognition and efficient resource usage.