A brain-computer interface that evokes tactile sensations improves robotic arm control

• Published in: Science (American Association for the Advancement of Science) Vol. 372; no. 6544; pp. 831 - 836
• Main Authors: Flesher, Sharlene N., Downey, John E., Weiss, Jeffrey M., Hughes, Christopher L., Herrera, Angelica J., Tyler-Kabara, Elizabeth C., Boninger, Michael L., Collinger, Jennifer L., Gaunt, Robert A.
• Format: Journal Article
• Language: English
• Published: United States The American Association for the Advancement of Science 21.05.2021
• Subjects: Adult; Arm; Arm - innervation; Arm - physiology; Artificial Limbs; Automation; Biological control; Biological effects; Brain; Brain-Computer Interfaces; Computer applications; Computer Interfaces; Computers; Cortex (motor); Feedback; Grasping; Hand Strength - physiology; Human performance; Human-computer interface; Humans; Implants; Interfaces; Male; Mimicry; Motor Cortex - physiology; Movement; Muscles; Neurological Impairments; Performance enhancement; Prostheses; Quadriplegia - therapy; Robot arms; Robot control; Robotics; Sensory feedback; Sensory neurons; Somatosensory cortex; Somatosensory Cortex - physiology; Spinal cord; Touch; Touch - physiology; Visual perception
• ISSN: 0036-8075; 1095-9203; 1095-9203
• DOI: 10.1126/science.abd0380

The finely controlled movement of our limbs requires two-way neuronal communication between the brain and the body periphery. This includes afferent information from muscles, joints, and skin, as well as visual feedback to plan, initiate, and execute motor output. In tetraplegia, this neural communication is interrupted in both directions at the level of the spinal cord. Brain–computer interfaces have been developed to produce voluntary motor output controlled by directly recording from brain activity. Flesher et al. added an afferent channel to the brain–computer interface to mimic sensory input from the skin of a hand (see the Perspective by Faisal). The improvements achieved by adding the afferent input were substantial in a battery of motor tasks tested in a human subject. Science , abd0380, this issue p. 831 ; see also abi7262, p. 791 Creating artificial tactile feedback greatly improves the ability of a person with tetraplegia to manipulate objects with a robotic limb. Prosthetic arms controlled by a brain-computer interface can enable people with tetraplegia to perform functional movements. However, vision provides limited feedback because information about grasping objects is best relayed through tactile feedback. We supplemented vision with tactile percepts evoked using a bidirectional brain-computer interface that records neural activity from the motor cortex and generates tactile sensations through intracortical microstimulation of the somatosensory cortex. This enabled a person with tetraplegia to substantially improve performance with a robotic limb; trial times on a clinical upper-limb assessment were reduced by half, from a median time of 20.9 to 10.2 seconds. Faster times were primarily due to less time spent attempting to grasp objects, revealing that mimicking known biological control principles results in task performance that is closer to able-bodied human abilities.