Development of a Speech-Based Augmented Reality System to Support Exploration of Cityscape

• Published in: Transactions in GIS Vol. 10; no. 1; pp. 63 - 86
• Main Authors: Bartie, Phil J., Mackaness, William A.
• Format: Journal Article
• Language: English
• Published: Oxford, UK Blackwell Publishing Ltd 01.01.2006
• ISSN: 1361-1682; 1467-9671
• DOI: 10.1111/j.1467-9671.2006.00244.x

When people explore new environments they often use landmarks as reference points to help navigate and orientate themselves. This research paper examines how spatial datasets can be used to build a system for use in an urban environment which functions as a city guide, announcing Features of Interest (FoI) as they become visible to the user (not just proximal), as the user moves freely around the city. Visibility calculations for the FoIs were pre‐calculated based on a digital surface model derived from LIDAR (Light Detection and Ranging) data. The results were stored in a text‐based relational database management system (RDBMS) for rapid retrieval. All interaction between the user and the system was via a speech‐based interface, allowing the user to record and request further information on any of the announced FoI. A prototype system, called Edinburgh Augmented Reality System (EARS), was designed, implemented and field tested in order to assess the effectiveness of these ideas. The application proved to be an innovative, ‘non‐invasive’ approach to augmenting the user's reality.