Binaural Auditory Information Fusion for Effective Supervisory Control of Mobile Multirobot Systems

• Published in: 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems pp. 19 - 24
• Main Authors: Trouvain, B.A., Schlick, C.M.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2006
• Subjects: Cognitive robotics; Control systems; Humans; Mobile robots; Multirobot systems; Payloads; Rendering (computer graphics); Robot control; Robot kinematics; Supervisory control
• DOI: 10.1109/MFI.2006.265614
• ISBN: 1424405661; 9781424405664

Supervisory control of mobile multirobot systems often forces the operator to concurrently process information of multiple visual displays under different task conditions. The approach of this paper is to design and evaluate a multimodal human-robot interface to support the processing of dual tasks. The main innovation of the multimodal interface is the binaural auditory information renderer which allows shifting of state information from the visual to the auditory channel of the operator. The multimodal interface was evaluated in a laboratory study with 20 participants. Dependent variables were human performance and workload. Independent variables were the interface modality (monomodal vs. multimodal) and the number of robots to be supervised (1 or 2 robots). The results show that the binaural information fusion significantly improves human performance and also significantly lowers the subjective workload (alpha = 0.05)