SLAM-based augmented reality for the assessment of short-term spatial memory. A comparative study of visual versus tactile stimuli

• Published in: PloS one Vol. 16; no. 2; p. e0245976
• Main Authors: Munoz-Montoya, Francisco, Juan, M-Carmen, Mendez-Lopez, Magdalena, Molla, Ramon, Abad, Francisco, Fidalgo, Camino
• Format: Journal Article
• Language: English
• Published: United States Public Library of Science 04.02.2021; Public Library of Science (PLoS)
• Subjects: Analysis; Animal memory; Auditory stimuli; Augmented Reality; Biology and Life Sciences; Comparative studies; Computer programs; Drafting software; Editing; Engineering and Technology; Funding; Human performance; Memory tasks; Methodology; People and Places; Reviews; Short term memory; Social Sciences; Software; Spatial analysis; Spatial memory; Tactile stimuli; Virtual reality; Visual stimuli; Spain
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0245976

The assessment of human spatial short-term memory has mainly been performed using visual stimuli and less frequently using auditory stimuli. This paper presents a framework for the development of SLAM-based Augmented Reality applications for the assessment of spatial memory. An AR mobile application was developed for this type of assessment involving visual and tactile stimuli by using our framework. The task to be carried out with the AR application is divided into two phases: 1) a learning phase, in which participants physically walk around a room and have to remember the location of simple geometrical shapes; and 2) an evaluation phase, in which the participants are asked to recall the location of the shapes. A study for comparing the performance outcomes using visual and tactile stimuli was carried out. Fifty-three participants performed the task using the two conditions (Tactile vs Visual), but with more than two months of difference (within-subject design). The number of shapes placed correctly was similar for both conditions. However, the group that used the tactile stimulus spent significantly more time completing the task and required significantly more attempts. The performance outcomes were independent of gender. Some significant correlations among variables related to the performance outcomes and other tests were found. The following significant correlations among variables related to the performance outcomes using visual stimuli and the participants' subjective variables were also found: 1) the greater the number of correctly placed shapes, the greater the perceived competence; 2) the more attempts required, the less the perceived competence. We also found that perceived enjoyment was higher when a higher sense of presence was induced. Our results suggest that tactile stimuli are valid stimuli to exploit for the assessment of the ability to memorize spatial-tactile associations, but that the ability to memorize spatial-visual associations is dominant. Our results also show that gender does not affect these types of memory tasks.