Brain–Machine Interface and Visual Compressive Sensing-Based Teleoperation Control of an Exoskeleton Robot

This paper presents a teleoperation control for an exoskeleton robotic system based on the brain-machine interface and vision feedback. Vision compressive sensing, brain-machine reference commands, and adaptive fuzzy controllers in joint-space have been effectively integrated to enable the robot per...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on fuzzy systems Vol. 25; no. 1; pp. 58 - 69
Main Authors Qiu, Shiyuan, Li, Zhijun, He, Wei, Zhang, Longbin, Yang, Chenguang, Su, Chun-Yi
Format Journal Article
LanguageEnglish
Published IEEE 01.02.2017
Subjects
Brain–machine interface (BMI)
Electroencephalography
electroencephalography (EEG) teleoperation
exoskeleton
Exoskeletons
Feature extraction
fuzzy logic system
Image coding
Robot sensing systems
visual compress sense
Visualization
Online AccessGet full text

Cover

More Information
Summary:This paper presents a teleoperation control for an exoskeleton robotic system based on the brain-machine interface and vision feedback. Vision compressive sensing, brain-machine reference commands, and adaptive fuzzy controllers in joint-space have been effectively integrated to enable the robot performing manipulation tasks guided by human operator's mind. First, a visual-feedback link is implemented by a video captured by a camera, allowing him/her to visualize the manipulator's workspace and movements being executed. Then, the compressed images are used as feedback errors in a nonvector space for producing steady-state visual evoked potentials electroencephalography (EEG) signals, and it requires no prior information on features in contrast to the traditional visual servoing. The proposed EEG decoding algorithm generates control signals for the exoskeleton robot using features extracted from neural activity. Considering coupled dynamics and actuator input constraints during the robot manipulation, a local adaptive fuzzy controller has been designed to drive the exoskeleton tracking the intended trajectories in human operator's mind and to provide a convenient way of dynamics compensation with minimal knowledge of the dynamics parameters of the exoskeleton robot. Extensive experiment studies employing three subjects have been performed to verify the validity of the proposed method.
ISSN:1063-6706
1941-0034
DOI:10.1109/TFUZZ.2016.2566676