Prosody for Intuitive Robotic Interface Design: It's Not What You Said, It's How You Said It

In this paper, we investigate the use of 'prosody' (the musical elements of speech) as a communicative signal for intuitive human-robot interaction interfaces. Our approach, rooted in Research through Design (RtD), examines the application of prosody in directing a quadruped robot navigati...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Sanoubari, Elaheh, Iscen, Atil, Takayama, Leila, Saliceti, Stefano, Cunningham, Corbin, Caluwaerts, Ken
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 13.03.2024
Subjects
Cues
Human communication
Human engineering
Lifelong learning
Linguistics
Man-machine interfaces
Navigation
Robot control
Robots
Online AccessGet full text

Cover

More Information
Summary:In this paper, we investigate the use of 'prosody' (the musical elements of speech) as a communicative signal for intuitive human-robot interaction interfaces. Our approach, rooted in Research through Design (RtD), examines the application of prosody in directing a quadruped robot navigation. We involved ten team members in an experiment to command a robot through an obstacle course using natural interaction. A human operator, serving as the robot's sensory and processing proxy, translated human communication into a basic set of navigation commands, effectively simulating an intuitive interface. During our analysis of interaction videos, when lexical and visual cues proved insufficient for accurate command interpretation, we turned to non-verbal auditory cues. Qualitative evidence suggests that participants intuitively relied on prosody to control robot navigation. We highlight specific distinct prosodic constructs that emerged from this preliminary exploration and discuss their pragmatic functions. This work contributes a discussion on the broader potential of prosody as a multifunctional communicative signal for designing future intuitive robotic interfaces, enabling lifelong learning and personalization in human-robot interaction.
ISSN:2331-8422