Occlusion Handling in Augmented Reality: Past, Present and Future

• Published in: IEEE transactions on visualization and computer graphics Vol. 29; no. 2; pp. 1590 - 1609
• Main Authors: Macedo, Marcio C. F., Apolinario, Antonio L.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.02.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Augmented reality; computational displays; Computer graphics; Data visualization; depth maps; Handling; mutual occlusion; Occlusion; Real-time systems; Search problems; Virtual reality; Visualization; X-ray imaging; X-ray vision
• ISSN: 1077-2626; 1941-0506
• DOI: 10.1109/TVCG.2021.3117866

One of the main goals of many augmented reality applications is to provide a seamless integration of a real scene with additional virtual data. To fully achieve that goal, such applications must typically provide high-quality real-world tracking, support real-time performance and handle the mutual occlusion problem, estimating the position of the virtual data into the real scene and rendering the virtual content accordingly. In this survey, we focus on the occlusion handling problem in augmented reality applications and provide a detailed review of 161 articles published in this field between January 1992 and August 2020. To do so, we present a historical overview of the most common strategies employed to determine the depth order between real and virtual objects, to visualize hidden objects in a real scene, and to build occlusion-capable visual displays. Moreover, we look at the state-of-the-art techniques, highlight the recent research trends, discuss the current open problems of occlusion handling in augmented reality, and suggest future directions for research.