A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 20; no. 5; pp. 720 - 729
• Main Authors: Long, Jinyi, Li, Yuanqing, Wang, Hongtao, Yu, Tianyou, Pan, Jiahui, Li, Feng
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.09.2012; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Ash; Biofeedback, Psychology - instrumentation; Brain; Brain-Computer Interfaces; Buttons; Computer simulation; Computer-Aided Design; Control systems; Direction; Electroencephalography; Electroencephalography - instrumentation; Equipment Design; Equipment Failure Analysis; Feature extraction; Flashing; Foot; Graphical user interface; Humans; hybrid brain-computer interface (BCI); Models, Theoretical; Motion; Motor ability; motor imagery; Motors; P300; speed; Systems Integration; User-Computer Interface; Vectors; Velocity control; wheelchair; Wheelchairs
• ISSN: 1534-4320; 1558-0210; 1558-0210
• DOI: 10.1109/TNSRE.2012.2197221

Brain-computer interfaces (BCIs) are used to translate brain activity signals into control signals for external devices. Currently, it is difficult for BCI systems to provide the multiple independent control signals necessary for the multi-degree continuous control of a wheelchair. In this paper, we address this challenge by introducing a hybrid BCI that uses the motor imagery-based mu rhythm and the P300 potential to control a brain-actuated simulated or real wheelchair. The objective of the hybrid BCI is to provide a greater number of commands with increased accuracy to the BCI user. Our paradigm allows the user to control the direction (left or right turn) of the simulated or real wheelchair using left- or right-hand imagery. Furthermore, a hybrid manner can be used to control speed. To decelerate, the user imagines foot movement while ignoring the flashing buttons on the graphical user interface (GUI). If the user wishes to accelerate, then he/she pays attention to a specific flashing button without performing any motor imagery. Two experiments were conducted to assess the BCI control; both a simulated wheelchair in a virtual environment and a real wheelchair were tested. Subjects steered both the simulated and real wheelchairs effectively by controlling the direction and speed with our hybrid BCI system. Data analysis validated the use of our hybrid BCI system to control the direction and speed of a wheelchair.