Task level hierarchical system for BCI-enabled shared autonomy

• Published in: 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids) pp. 219 - 225
• Main Authors: Akinola, Iretiayo, Boyuan Chen, Koss, Jonathan, Patankar, Aalhad, Varley, Jake, Allen, Peter
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.11.2017
• Subjects: Electroencephalography; Navigation; Reliability; Robot sensing systems; Visualization
• ISSN: 2164-0580
• DOI: 10.1109/HUMANOIDS.2017.8246878

This paper describes a novel hierarchical system for shared control of a humanoid robot. Our framework uses a low-bandwidth Brain Computer Interface (BCI) to interpret electroencephalography (EEG) signals via Steady-State Visual Evoked Potentials (SSVEP). This BCI allows a user to reliably interact with the humanoid. Our system clearly delineates between autonomous robot operation and human-guided intervention and control. Our shared-control system leverages the ability of the robot to accomplish low level tasks on its own, while the user assists the robot with high level directions when needed. This partnership prevents fatigue of the human controller by not requiring continuous BCI control to accomplish tasks which can be automated. We have tested the system in simulation and in real physical settings with multiple subjects using a Fetch mobile manipulator. Working together, the robot and human controller were able to accomplish tasks such as navigation, pick and place, and table clean up.