Multimodal feedback: An assessment of perforance and mental workload

Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multim...

Full description

Saved in:
Bibliographic Details
Published inErgonomics Vol. 46; no. 1-3; p. 68
Main Authors Vitense, H S, Jacko, J A, Emery, V K
Format Journal Article
LanguageEnglish
Published London Taylor & Francis LLC 15.01.2003
Subjects
Cognition & reasoning
Ergonomics
Feedback
Online AccessGet full text

Cover

More Information
Summary:Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.
ISSN:0014-0139
1366-5847