SYSTEMS AND METHODS FOR BRAIN-INFORMED SPEECH SEPARATION

• Main Authors: HAN, Cong, MESGARANI, Nima, CEOLINI, Enea
• Format: Patent
• Language: English; French; German
• Published: 21.08.2024
• Subjects: ACOUSTICS; ADVERTISING; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND,DEAF OR MUTE; CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; CRYPTOGRAPHY; DIAGNOSIS; DIAGRAMS; DISPLAY; EDUCATION; EDUCATIONAL OR DEMONSTRATION APPLIANCES; GLOBES; HUMAN NECESSITIES; HYGIENE; IDENTIFICATION; MEDICAL OR VETERINARY SCIENCE; MUSICAL INSTRUMENTS; PHYSICS; PLANETARIA; SEALS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION; SURGERY

Disclosed are methods, systems, device, and other implementations, including a method (performed by, for example, a hearing aid device) that includes obtaining a combined sound signal for signals combined from multiple sound sources in an area in which a person is located, and obtaining neural signals for the person, with the neural signals being indicative of one or more target sound sources, from the multiple sound sources, the person is attentive to. The method further includes determining a separation filter based, at least in part, on the neural signals obtained for the person, and applying the separation filter to a representation of the combined sound signal to derive a resultant separated signal representation associated with sound from the one or more target sound sources the person is attentive to.