Hand Tracking with Vibrotactile Feedback Enhanced Presence, Engagement, Usability, and Performance in a Virtual Reality Rhythm Game

Recent hand tracking systems and wearable haptic devices have contributed to enhancing user experience in virtual environments. However, controllers are still prevalent in virtual reality (VR) games as a main interaction device. Also, haptic devices are rare and not widely accepted by users. In this...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of human-computer interaction Vol. 39; no. 14; pp. 2840 - 2851
Main Authors Moon, Hye Sung, Orr, Grady, Jeon, Myounghoon
Format Journal Article
LanguageEnglish
Published Norwood Taylor & Francis 27.08.2023
Lawrence Erlbaum Associates, Inc
Subjects
Computer & video games
Controllers
Feedback
Games
Gloves
Haptic interfaces
Rhythm
Tracking control
Tracking systems
User experience
User interfaces
Virtual environments
Virtual reality
Online AccessGet full text

Cover

More Information
Summary:Recent hand tracking systems and wearable haptic devices have contributed to enhancing user experience in virtual environments. However, controllers are still prevalent in virtual reality (VR) games as a main interaction device. Also, haptic devices are rare and not widely accepted by users. In this article, we examined the effects of interaction methods and vibrotactile feedback on users' sense of presence, engagement, usability, and task performance in a VR game. In our experiment, 36 participants wearing VR goggle played a rhythm game under three conditions: (1) VR controllers, (2) hand tracking without vibrotactile feedback, and (3) hand tracking with vibrotactile feedback at fingertips through the gloves we developed. Results showed that hand tracking improved presence, engagement, usability, and performance, compared to the VR controller. Furthermore, vibrotactile feedback enhanced presence and engagement even more clearly. Results are discussed with the components of VR user experience and practical design guidelines.
ISSN:1044-7318
1532-7590
1044-7318
DOI:10.1080/10447318.2022.2087000