Local and Remote Cooperation With Virtual and Robotic Agents: A P300 BCI Study in Healthy and People Living With Spinal Cord Injury

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 25; no. 9; pp. 1622 - 1632
• Main Authors: Tidoni, Emmanuele, Abu-Alqumsan, Mohammad, Leonardis, Daniele, Kapeller, Christoph, Fusco, Gabriele, Guger, Cristoph, Hintermuller, Cristoph, Peer, Angelika, Frisoli, Antonio, Tecchia, Franco, Bergamasco, Massimo, Aglioti, Salvatore Maria
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.09.2017
• Subjects: Adult; Body illusions - tendon vibration; Brain-Computer Interfaces; brain–computer interface (BCI) P300; Electroencephalography; Event-Related Potentials, P300; Female; Games; Humans; IEEE members; Imagination; Male; Man-Machine Systems; Movement; Reproducibility of Results; Robot sensing systems; Robotics - methods; Sensitivity and Specificity; Spinal Cord Injuries - physiopathology; Spinal Cord Injuries - rehabilitation; spinal cord injury; Task Performance and Analysis; teleoperation; Tendons; User-Computer Interface; virtual reality; Visualization; Young Adult
• ISSN: 1534-4320; 1558-0210
• DOI: 10.1109/TNSRE.2016.2626391

The development of technological applications that allow people to control and embody external devices within social interaction settings represents a major goal for current and future brain-computer interface (BCI) systems. Prior research has suggested that embodied systems may ameliorate BCI end-user's experience and accuracy in controlling external devices. Along these lines, we developed an immersive P300-based BCI application with a head-mounted display for virtual-local and robotic-remote social interactions and explored in a group of healthy participants the role of proprioceptive feedback in the control of a virtual surrogate (Study 1). Moreover, we compared the performance of a small group of people with spinal cord injury (SCI) to a control group of healthy subjects during virtual and robotic social interactions (Study 2), where both groups received a proprioceptive stimulation. Our attempt to combine immersive environments, BCI technologies and neuroscience of body ownership suggests that providing realistic multisensory feedback still represents a challenge. Results have shown that healthy and people living with SCI used the BCI within the immersive scenarios with good levels of performance (as indexed by task accuracy, optimizations calls and Information Transfer Rate) and perceived control of the surrogates. Proprioceptive feedback did not contribute to alter performance measures and body ownership sensations. Further studies are necessary to test whether sensorimotor experience represents an opportunity to improve the use of future embodied BCI applications.