Online speech synthesis using a chronically implanted brain-computer interface in an individual with ALS

Recent studies have shown that speech can be reconstructed and synthesized using only brain activity recorded with intracranial electrodes, but until now this has only been done using retrospective analyses of recordings from able-bodied patients temporarily implanted with electrodes for epilepsy su...

Full description

Saved in:
Bibliographic Details
Published inmedRxiv : the preprint server for health sciences
Main Authors Angrick, Miguel, Luo, Shiyu, Rabbani, Qinwan, Candrea, Daniel N, Shah, Samyak, Milsap, Griffin W, Anderson, William S, Gordon, Chad R, Rosenblatt, Kathryn R, Clawson, Lora, Maragakis, Nicholas, Tenore, Francesco V, Fifer, Matthew S, Hermansky, Hynek, Ramsey, Nick F, Crone, Nathan E
Format Journal Article
LanguageEnglish
Published United States 01.07.2023
Online AccessGet more information

Cover

More Information
Summary:Recent studies have shown that speech can be reconstructed and synthesized using only brain activity recorded with intracranial electrodes, but until now this has only been done using retrospective analyses of recordings from able-bodied patients temporarily implanted with electrodes for epilepsy surgery. Here, we report online synthesis of intelligible words using a chronically implanted brain-computer interface (BCI) in a clinical trial participant (ClinicalTrials.gov, NCT03567213) with dysarthria due to amyotrophic lateral sclerosis (ALS). We demonstrate a reliable BCI that synthesizes commands freely chosen and spoken by the user from a vocabulary of 6 keywords originally designed to allow intuitive selection of items on a communication board. Our results show for the first time that a speech-impaired individual with ALS can use a chronically implanted BCI to reliably produce synthesized words that are intelligible to human listeners while preserving the participants voice profile.