“We Didn’t Catch That!” Using Voice Text Input on a Mixed Reality Headset in Noisy Environments

• Published in: Proceedings of the Human Factors and Ergonomics Society Annual Meeting Vol. 64; no. 1; pp. 2102 - 2106
• Main Authors: Derby, Jessyca L., Rickel, Emily A., Harris, Kelly J., Lovell, Jade A., Chaparro, Barbara S.
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.12.2020
• ISSN: 1071-1813; 2169-5067
• DOI: 10.1177/1071181320641509

The Microsoft HoloLens, a mixed reality head-mounted display (HMD), has been demonstrated in domains such as medicine, engineering, and manufacturing. In order to interact with the device, voice input may be required. Given this range of environments, it is necessary to understand the impact of noise on voice dictation speed and accuracy. In this study, we evaluated the dictation feature of the HoloLens through speed (WPM), accuracy (WER), perceived workload, and perceived usability at three different noise levels: 40 dB, 55 dB, and 70 dB. No differences were found across noise levels in speed (67-75 WPM), or perceived workload. Accuracy and perceived usability worsened in the 70 dB noise condition. Only 37.5% of participants were able to successfully dictate in the 70 dB condition. This study shows that if the HoloLens is to be accepted in environments with high noise levels, improvements to dictation need to be made.