Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning

• Published in: Experimental brain research Vol. 233; no. 3; pp. 909 - 925
• Main Authors: Sigrist, Roland, Rauter, Georg, Marchal-Crespo, Laura, Riener, Robert, Wolf, Peter
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.03.2015; Springer; Springer Nature B.V
• Subjects: Adult; Auditory Perception - physiology; Biofeedback; Biomedical and Life Sciences; Biomedicine; Design; Feedback; Feedback, Sensory - physiology; Female; Haptics; Humans; Hypotheses; Investigations; Learning - physiology; Male; Methods; Motor learning; Motor Skills - physiology; Neurology; Neurosciences; Psychological aspects; Psychomotor Performance - physiology; Rehabilitation; Research Article; Rowing; Sound; Touch; Touch Perception - physiology; Training; Visual Perception - physiology; Young Adult; Augmented feedback; Haptic guidance; Movement sonification; Rowing simulator; Robot-assisted learning; Multimodal feedback
• ISSN: 0014-4819; 1432-1106; 1432-1106
• DOI: 10.1007/s00221-014-4167-7

Concurrent augmented feedback has been shown to be less effective for learning simple motor tasks than for complex tasks. However, as mostly artificial tasks have been investigated, transfer of results to tasks in sports and rehabilitation remains unknown. Therefore, in this study, the effect of different concurrent feedback was evaluated in trunk-arm rowing. It was then investigated whether multimodal audiovisual and visuohaptic feedback are more effective for learning than visual feedback only. Naïve subjects ( N  = 24) trained in three groups on a highly realistic virtual reality-based rowing simulator. In the visual feedback group, the subject’s oar was superimposed to the target oar, which continuously became more transparent when the deviation between the oars decreased. Moreover, a trace of the subject’s trajectory emerged if deviations exceeded a threshold. The audiovisual feedback group trained with oar movement sonification in addition to visual feedback to facilitate learning of the velocity profile. In the visuohaptic group, the oar movement was inhibited by path deviation-dependent braking forces to enhance learning of spatial aspects. All groups significantly decreased the spatial error (tendency in visual group) and velocity error from baseline to the retention tests. Audiovisual feedback fostered learning of the velocity profile significantly more than visuohaptic feedback. The study revealed that well-designed concurrent feedback fosters complex task learning, especially if the advantages of different modalities are exploited. Further studies should analyze the impact of within-feedback design parameters and the transferability of the results to other tasks in sports and rehabilitation.