ARSlice: Head-Mounted Display Augmented with Dynamic Tracking and Projection

• Published in: Journal of computer science and technology Vol. 37; no. 3; pp. 666 - 679
• Main Authors: Wang, Yu-Ping, Xie, Sen-Wei, Wang, Li-Hui, Xu, Hongjin, Tabata, Satoshi, Ishikawa, Masatoshi
• Format: Journal Article
• Language: English
• Published: Singapore Springer Nature Singapore 01.06.2022; Springer; Springer Nature B.V; Tokyo University of Science, Tokyo 113-8601,Japan; Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China%Institute of Semiconductors,Guangdong Academy of Sciences,Guangzhou 510651,China; Data Science Research Division,Information Technology Center,The University of Tokyo,Tokyo 113-8656,Japan%Core Network Department,Advanced Operations Development Division,KDDI Cooperation,Tokyo 206-0034,Japan 5 Tokyo University of Science,Tokyo 113-8601,Japan%Data Science Research Division,Information Technology Center,The University of Tokyo,Tokyo 113-8656,Japan%Data Science Research Division,Information Technology Center,The University of Tokyo,Tokyo 113-8656,Japan
• Subjects: Artificial Intelligence; Augmented reality; Computed tomography; Computer Science; CT imaging; Data Structures and Information Theory; Energy consumption; Helmet mounted displays; Information Systems Applications (incl.Internet); Medical imaging; Medical technology; Projectors; Prototypes; Regular Paper; Software Engineering; Theory of Computation; Tracking; Virtual reality; Weight reduction; Wireless networks; augmented and virtual reality; computed tomography (CT) image visualization; interactive visualization; computed tomography(CT)image visualization
• ISSN: 1000-9000; 1860-4749
• DOI: 10.1007/s11390-022-2173-y

Computed tomography (CT) generates cross-sectional images of the body. Visualizing CT images has been a challenging problem. The emergence of the augmented and virtual reality technology has provided promising solutions. However, existing solutions suffer from tethered display or wireless transmission latency. In this paper, we present ARSlice, a proof-of-concept prototype that can visualize CT images in an untethered manner without wireless transmission latency. Our ARSlice prototype consists of two parts, the user end and the projector end. By employing dynamic tracking and projection, the projector end can track the user-end equipment and project CT images onto it in real time. The user-end equipment is responsible for displaying these CT images into the 3D space. Its main feature is that the user-end equipment is a pure optical device with light weight, low cost, and no energy consumption. Our experiments demonstrate that our ARSlice prototype provides part of six degrees of freedom for the user, and a high frame rate. By interactively visualizing CT images into the 3D space, our ARSlice prototype can help untrained users better understand that CT images are slices of a body.