An Empirical Evaluation of the Calibration of Auditory Distance Perception under Different Levels of Virtual Environment Visibilities

• Published in: Proceedings (IEEE Conference on Virtual Reality and 3D User Interfaces. Online) pp. 690 - 700
• Main Authors: Lin, Wan-Yi, Venkatakrishnan, Rohith, Venkatakrishnan, Roshan, Babu, Sabarish V., Pagano, Christopher, Lin, Wen-Chieh
• Format: Conference Proceeding
• Language: English
• Published: IEEE 16.03.2024
• Subjects: Auditory Distance Perception; Calibration; Lighting; Perceptual Learning and Calibration; Task analysis; Three-dimensional displays; User interfaces; Virtual environments; Virtual Reality; Visualization
• ISSN: 2642-5254
• DOI: 10.1109/VR58804.2024.00089

The perception of distance is a complex process that often involves sensory information beyond that of just vision. In this work, we investigated if depth perception based on auditory information can be calibrated, a process by which perceptual accuracy of depth judgments can be improved by providing feedback and then performing corrective actions. We further investigated if perceptual learning through carryover effects of calibration occurs in different levels of a virtual environment's visibility based on different levels of virtual lighting. Users performed an auditory depth judgment task over several trials in which they walked where they perceived an aural sound to be, yielding absolute estimates of perceived distance. This task was performed in three sequential phases: pretest, calibration, posttest. Feedback on the perceptual accuracy of distance estimates was only provided in the calibration phase, allowing to study the calibration of auditory depth perception. We employed a 2 (Visibility of virtual environment) \times 3 (Phase) \times 5 (Target Distance) multi-factorial design, manipulating the phase and target distance as within-subjects factors, and the visibility of the virtual environment as a between-subjects factor. Our results revealed that users generally tend to underestimate aurally perceived distances in VR similar to the distance compression effects that commonly occur in visual distance perception in VR. We found that auditory depth estimates, obtained using an absolute measure, can be calibrated to become more accurate through feedback and corrective action. In terms of environment visibility, we find that environments visible enough to reveal their extent may contain visual information that users attune to in scaling aurally perceived depth.