BendableSound: An elastic multisensory surface using touch-based interactions to assist children with severe autism during music therapy

• Published in: International journal of human-computer studies Vol. 107; pp. 22 - 37
• Main Authors: Cibrian, Franceli L., Peña, Oscar, Ortega, Deysi, Tentori, Monica
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.11.2017
• Subjects: Autism; Elastic surfaces; Multisensory interfaces; Neurologic music therapy; Strength and timing regulation; Strength and timing regulation; Multisensory interfaces; Autism; Elastic surfaces; Neurologic music therapy
• ISSN: 1071-5819; 1095-9300
• DOI: 10.1016/j.ijhcs.2017.05.003

•BendableSound is an elastic multisensory surface to assist music therapy sessions.•BendableSound has the potential to provide a more natural and intuitive multisensory experience.•Elastic multisensory surfaces promote the discovery of new tactile experiences.•BendableSound helps children with autism to maintain their attention during therapy.•BendableSound could have therapeutic benefits regarding motor development. Neurological Music Therapy uses live music to improve the sensorimotor regulation of children with severe autism. However, they often lack musical training and their impairments limit their interactions with musical instruments. In this paper, we present our co-design work that led to the BendableSound prototype: an elastic multisensory surface encouraging users to practice coordination movements when touching a fabric to play sounds. We present the results of a formative study conducted with 18 teachers showing BendableSound was perceived as “usable” and “attractive”. Then, we present a deployment study with 24 children with severe autism showing BendableSound is “easy to use” and may potentially have therapeutic benefits regarding attention and motor development. We propose a set of design insights that could guide the design of natural user interfaces, particularly elastic multisensory surfaces. We close with a discussion and directions for future work.