(Gestures Vaguely): The Effects of Robots' Use of Abstract Pointing Gestures in Large-Scale Environments

• Published in: 2024 19th ACM/IEEE International Conference on Human-Robot Interaction (HRI) pp. 293 - 302
• Main Authors: Huang, Annie, Ranucci, Alyson, Stogsdill, Adam, Clark, Grace, Schott, Keenan, Higger, Mark, Han, Zhao, Williams, Tom
• Format: Conference Proceeding
• Language: English
• Published: ACM 11.03.2024
• Subjects: anthropomorphism; Deixis; Design methodology; Hardware; Human computer interaction; Human-robot interaction; human-robot interaction (HRI); Measurement; non-verbal communication; Organizations; spatial reference; Virtual reality; virtual reality (VR)
• DOI: 10.1145/3610977.3634924

As robots are deployed into large-scale human environments, they will need to engage in task-oriented dialogues about objects and locations beyond those that can currently be seen. In these contexts, speakers use a wide range of referring gestures beyond those used in the small-scale interaction contexts that HRI research typically investigates. In this work, we thus seek to understand how robots can better generate gestures to accompany their referring language in large-scale interaction contexts. In service of this goal, we present the results of two human-subject studies: (1) a humanhuman study exploring how human gestures change in large-scale interaction contexts, and to identify human-like gestures suitable to such contexts yet readily implemented on robot hardware; and (2) a human-robot study conducted in a tightly controlled Virtual Reality environment, to evaluate robots' use of those identified gestures. Our results show that robot use of Precise Deictic and Abstract Pointing gestures afford different types of benefits when used to refer to visible vs. non-visible referents, leading us to formulate three concrete design guidelines. These results highlight both the opportunities for robot use of more humanlike gestures in large-scale interaction contexts, as well as the need for future work exploring their use as part of multi-modal communication.CCS CONCEPTS* Computer systems organization → Robotics; * Human-centered computing → Virtual reality; Empirical studies in interaction design.