Hybrid fNIRS-EEG based classification of auditory and visual perception processes

• Published in: Frontiers in neuroscience Vol. 8; p. 373
• Main Authors: Putze, Felix, Hesslinger, Sebastian, Tse, Chun-Yu, Huang, YunYing, Herff, Christian, Guan, Cuntai, Schultz, Tanja
• Format: Journal Article
• Language: English
• Published: Switzerland Frontiers Research Foundation 18.11.2014; Frontiers Media S.A
• Subjects: Auditory perception; Brain; Brain research; Classification; Cognitive ability; Computer applications; EEG; Electroencephalography; fNIRS; HCI; Hearing; hybrid BCI; Implants; Information processing; Infrared spectroscopy; modality recognition; Neuroscience; Sensors; Sensory integration; Spectrum analysis; User interface; Visual perception; Visual stimuli; Workloads; New York; Singapore; fNIRS; EEG; brain-computer interface; visual and auditory perception

For multimodal Human-Computer Interaction (HCI), it is very useful to identify the modalities on which the user is currently processing information. This would enable a system to select complementary output modalities to reduce the user's workload. In this paper, we develop a hybrid Brain-Compu...