Deictic believability: Coordinated gesture, locomotion, and speech in lifelike pedagogical agents

• Published in: Applied artificial intelligence Vol. 13; no. 4-5; pp. 383 - 414
• Main Authors: Lester, James C., Voerman, Jennifer L., Towns, Stuart G., Callaway, Charles B.
• Format: Journal Article
• Language: English
• Published: Taylor & Francis Group 01.05.1999
• ISSN: 0883-9514; 1087-6545
• DOI: 10.1080/088395199117324

Lifelike animated agents for knowledge - based learning environments can provide timely , customized advice to support students' problem solving . Because of their strong visual presence , they hold significant promise for substantially increasing students' enjoyment of their learning experiences . A key problemposed by lifelike agents that inhabit artificial worlds is deictic believability. In the same manner that humans refer to objects in their environment through judicious combinations of speech , locomotion , and gesture , animated agents should be able to move through their environment and point to and refer to objects appropriately as they provide problem - solving advice . In this paper we describe a framework for achieving deictic believability in animated agents . A deictic behavior planner exploits a world model and the evolving explanation plan as it selects and coordinates locomotive , gestural , and speech behaviors . The resulting behaviors and utterances are believable , and the references exhibit a lack of ambiguity . This approach to spatial deixis has been implemented in a lifelike animated agent , COSMO , who inhabits a learning environment for the domain of Internet packet routing . COSMO provides real - time advice to students as they escort packets through a virtual world of interconnected routers . Results of an informal focus group study with the COSMOagent suggest that the spatial deixis framework produces clear explanatory animated behaviors .