Cross-dimensional gestural interaction techniques for hybrid immersive environments

• Published in: IEEE Proceedings. VR 2005. Virtual Reality, 2005 pp. 209 - 216
• Main Authors: Benko, H., Ishak, E.W., Feiner, S.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 2005
• Subjects: Augmented reality; Collaborative work; Computer displays; Computer science; Data visualization; Testing; Three dimensional displays; Two dimensional displays; User interfaces; Virtual reality
• ISBN: 0780389298; 9780780389298
• ISSN: 1087-8270
• DOI: 10.1109/VR.2005.1492776

We present a set of cross-dimensional interaction techniques for a hybrid user interface that integrates existing 2D and 3D visualization and interaction devices. Our approach is built around one-and two-handed gestures that support the seamless transition of data between co-located 2D and 3D contexts. Our testbed environment combines a 2D multi-user, multi-touch, projection surface with 3D head-tracked, see-through, head-worn displays and 3D tracked gloves to form a multi-display augmented reality. We address some of the ways in which we can interact with private data in a collaborative, heterogeneous workspace. We also report on a pilot usability study to evaluate the effectiveness and ease of use of the cross-dimensional interactions.