A Multimodal Interface for Virtual Information Environments

• Published in: Virtual, Augmented and Mixed Reality. Multimodal Interaction Vol. 11574; pp. 59 - 70
• Main Authors: Hansberger, Jeffrey T., Peng, Chao, Blakely, Victoria, Meacham, Sarah, Cao, Lizhou, Diliberti, Nicholas
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2019; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Gesture recognition; Multimodal interface; Virtual environment
• ISBN: 9783030216061; 3030216063
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-21607-8_5

Continuing advances in multimodal technology, machine learning, and virtual reality are providing the means to explore and develop multimodal interfaces that are faster, more accurate, and more meaningful in the interactions they support. This paper describes an ongoing effort to develop an interface using input from voice, hand gestures, and eye gaze to interact with information in a virtual environment. A definition for a virtual environment tailored for the presentation and manipulation of information is introduced along with a new metaphor for multimodal interactions within a virtual environment.