FlyAR: Augmented Reality Supported Micro Aerial Vehicle Navigation

• Published in: IEEE transactions on visualization and computer graphics Vol. 20; no. 4; pp. 560 - 568
• Main Authors: Zollmann, Stefanie, Hoppe, Christof, Langlotz, Tobias, Reitmayr, Gerhard
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.04.2014; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Aerials; Aircraft - instrumentation; Augmented reality; Augmented reality; Micro aerial vehicles; Visualization; Cameras; Data visualization; Depth Perception - physiology; Flight; Flight planning; Flying; Humans; Imaging, Three-Dimensional - instrumentation; Imaging, Three-Dimensional - methods; Man-Machine Systems; Micro air vehicles (MAV); Military aircraft; Miniaturization; Navigation; Orientation - physiology; R&D; Research & development; Robots; Three-dimensional displays; User-Computer Interface; Vehicles; Visualization
• ISSN: 1077-2626; 1941-0506; 1941-0506
• DOI: 10.1109/TVCG.2014.24

Micro aerial vehicles equipped with high-resolution cameras can be used to create aerial reconstructions of an area of interest. In that context automatic flight path planning and autonomous flying is often applied but so far cannot fully replace the human in the loop, supervising the flight on-site to assure that there are no collisions with obstacles. Unfortunately, this workflow yields several issues, such as the need to mentally transfer the aerial vehicle's position between 2D map positions and the physical environment, and the complicated depth perception of objects flying in the distance. Augmented Reality can address these issues by bringing the flight planning process on-site and visualizing the spatial relationship between the planned or current positions of the vehicle and the physical environment. In this paper, we present Augmented Reality supported navigation and flight planning of micro aerial vehicles by augmenting the user's view with relevant information for flight planning and live feedback for flight supervision. Furthermore, we introduce additional depth hints supporting the user in understanding the spatial relationship of virtual waypoints in the physical world and investigate the effect of these visualization techniques on the spatial understanding.