Design and user experience analysis of AR intelligent virtual agents on smartphones

• Published in: Cognitive systems research Vol. 78; pp. 33 - 47
• Main Authors: Gan, Quehong, Liu, Zhen, Liu, Tingting, Zhao, Yumeng, Chai, Yanjie
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.03.2023
• Subjects: Augmented reality; Cognitive architecture; Emotional expression; Intelligent virtual agents; Uncertainty; User experience; Intelligent virtual agents; Cognitive architecture; Emotional expression; Uncertainty; User experience; Augmented reality
• ISSN: 1389-0417; 1389-0417
• DOI: 10.1016/j.cogsys.2022.11.007

Intelligent Virtual Agents (IVAs) can provide users with a friendly experience and have a wide range of applications in the era of artificial intelligence. However, most of existing IVAs are designed for personal computers. Design and user studies of IVAs on smartphones are uncommon. Therefore, developing IVAs for smartphones is an interesting topic. Considering Augmented Reality (AR) technology can provide more potential application value for IVAs, we mainly investigate users’ experiences of AR IVAs on smartphones in this paper. To make an IVA more suitable for a smartphone, a lightweight IVA’s cognitive architecture is proposed. To find out the factors that affect users’ interaction experiences, the effects of humanoid embodiment and emotional expressions of IVAs on users’ perceptions and experiences are explored. A museum is used as a specific task scenario to measure users’ experiences. Three forms of AR agents are evaluated in this scenario: a voice assistant without an entity, a humanoid IVA without emotional expressions, and a humanoid IVA with emotional expressions. The results show that compared with the voice assistant, a humanoid embodiment can significantly improve the user’s experience, and compared with humanoid IVA without emotional expressions, a humanoid IVA with emotional expressions is more welcome. Moreover, we use the cloud model to describe the uncertainty of IVAs’ actions (blinking and body orientation). The results show that the uncertainty of actions can increase the believability of IVAs.