Adaptive Multimodal Music Learning via Interactive-haptic Instrument

Haptic interfaces have untapped the sense of touch to assist multimodal music learning. We have recently seen various improvements of interface design on tactile feedback and force guidance aiming to make instrument learning more effective. However, most interfaces are still quite static; they canno...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Zhang, Yian, Li, Yinmiao, Chin, Daniel, Xia, Gus
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 04.06.2019
Subjects
Adaptive control
Haptic interfaces
Human performance
Interactive control
Learning
Sensory feedback
Online AccessGet full text

Cover

More Information
Summary:Haptic interfaces have untapped the sense of touch to assist multimodal music learning. We have recently seen various improvements of interface design on tactile feedback and force guidance aiming to make instrument learning more effective. However, most interfaces are still quite static; they cannot yet sense the learning progress and adjust the tutoring strategy accordingly. To solve this problem, we contribute an adaptive haptic interface based on the latest design of haptic flute. We first adopted a clutch mechanism to enable the interface to turn on and off the haptic control flexibly in real time. The interactive tutor is then able to follow human performances and apply the "teacher force" only when the software instructs so. Finally, we incorporated the adaptive interface with a step-by-step dynamic learning strategy. Experimental results showed that dynamic learning dramatically outperforms static learning, which boosts the learning rate by 45.3% and shrinks the forgetting chance by 86%.
ISSN:2331-8422