Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures

• Published in: Sensors (Basel, Switzerland) Vol. 21; no. 5; p. 1582
• Main Authors: Wang, Yahui, Wang, Yueyang, Chen, Jingzhou, Wang, Yincheng, Yang, Jie, Jiang, Ting, He, Jibo
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 24.02.2021; MDPI
• Subjects: Design; Efficiency; Experiments; gesture recognition; Gestures; Hand; Humans; Interactive computer systems; Keyboards; Methods; Posture; subjective experience; task workload; typing performance; User experience; User-Computer Interface; Virtual Reality; word-gesture text entry technology; Workloads; subjective experience; virtual reality; gesture recognition; word-gesture text entry technology; task workload; typing performance
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s21051582

Although the interaction technology for virtual reality (VR) systems has evolved significantly over the past years, the text input efficiency in the virtual environment is still an ongoing problem. We deployed a word-gesture text entry technology based on gesture recognition in the virtual environment. This study aimed to investigate the performance of the word-gesture text entry technology with different input postures and VR experiences in the virtual environment. The study revealed that the VR experience (how long or how often using VR) had little effect on input performance. The hand-up posture has a better input performance when using word-gesture text entry technology in a virtual environment. In addition, the study found that the perceived exertion to complete the text input with word-gesture text entry technology was relatively high. Furthermore, the typing accuracy and perceived usability for using the hand-up posture were obviously higher than that for the hand-down posture. The hand-up posture also had less task workload than the hand-down posture. This paper supports that the word-gesture text entry technology with hand-up posture has greater application potential than hand-down posture.