Situational Signal Processing with Ecological Momentary Assessment: Leveraging Environmental Context for Cochlear Implant Users

• Published in: Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) pp. 2131 - 2135
• Main Authors: Lawson, Taylor, Hansen, John H. L.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 14.04.2024
• Subjects: "Emaging"; Auditory system; CCi-MOBILE; Cochlear implant (CI); Cochlear implants; Location awareness; non-linguistic; Real-time systems; Signal processing; Signal processing algorithms; situational signal processing; sound source localization (SSL); Tagging; wearable and portable devices
• ISSN: 2379-190X
• DOI: 10.1109/ICASSP48485.2024.10447591

Technological advancements for biomedical interfaces and devices, such as cochlear implants (CIs), depend on the integration of novel signal processing strategies enhanced by situational real-time feedback in naturalistic spontaneous environments. This study proposes the first CI framework for situational signal processing, "Emaging", which incorporates ecological momentary assessment (EMA) on portable and wearable devices. The original "Emaging" application operates simultaneously with the CCi-MOBILE platform, a customized portable signal processing CI platform. EMA is an integrative variant of behavioral medicine research that evaluates physiological and psychological outcomes of individuals in natural contexts and incorporates real-time signaling that prompts the subject to report on their current state in a non-clinical environment. "Emaging" considers two parameters of EMA for the CI subject: sound source localization (SSL) and sound source identification (SSI) for non-spoken sounds. SSL involves neurological coding of interaural time and level differences (ITDs and ILDs), which enable the listener to localize auditory stimuli. SSI, which entails identifying what sound was heard, is especially challenging for CI users due to commercial CI algorithms predominantly optimized for speech perception. With "Emaging", CI users document and "tag" their respective experiences with SSL and SSI in a natural real-time environment on their portable and wearable devices. The "tagging" can run simultaneously with regular CCi-MOBILE processing in online or offline scenarios. CCi-MOBILE's synchronization with "Emaging" provides a unique opportunity for next generational algorithm design based on situational signal processing algorithms. Such algorithms are conducive to more effective non-linguistic sound coding strategies for next-generation biomedical hearing devices.