The “rebirth” of traditional musical instrument: An interactive installation based on augmented reality and somatosensory technology to empower the exhibition of chimes

• Published in: Computer animation and virtual worlds Vol. 34; no. 3-4
• Main Authors: Guo, Wenchen, Huang, Yiyuan, Chen, Zhirui, Zhang, Zixun, Sun, Guoyu, Zeng, Qingxiang, Li, Xiao
• Format: Journal Article
• Language: English
• Published: Hoboken, USA John Wiley & Sons, Inc 01.05.2023; Wiley Subscription Services, Inc
• Subjects: Augmented reality; Chinese chimes; Cultural heritage; Cultural resources; Empowerment; Mixed reality; Museums; Musical instruments; somatosensory interaction; user experience
• ISSN: 1546-4261; 1546-427X
• DOI: 10.1002/cav.2171

Tangible cultural heritage is rich in historical, artistic and scientific value, but due to its own characteristics and the constraints of museum displays, the key issue facing us today is how to utilize and activate cultural heritage to enhance the experience and learning interest of the audience. Focusing on the Chinese cultural treasure, the chimes, this article innovatively proposes an interaction system based on digital augmented projection and somatosensory technology to empower the aesthetic expression and knowledge dissemination of chimes. On this basis, a series of evaluations were carried out and the results showed that the system effectively provides a satisfying, personalized and fun way for users to interact with chimes and learn the traditional culture, successfully bringing this ancient instrument back to life. Moreover, this article shares in detail the research, design and development process, which provides inspiration and examples for other museums to present their tangible cultural heritage through mixed reality and interactive technology. This article innovatively proposes an interaction system named Encounter with Chimes which based on digital augmented projection and somatosensory technology to empower the aesthetic expression and knowledge dissemination of chimes. Moreover, a series of evaluations were carried out and the results showed that the system effectively provides a satisfying, personalized and fun way for users to interact with chimes and learn the traditional culture, successfully bringing this ancient instrument back to life.