Towards Classification of Engagement in Human Interaction with Talking Robots

In this paper we describe ongoing work to develop an engagement classifier for human-computer interaction systems. We have successfully classified group and individual engagement in a corpus of a conversation among four people called TableTalk, by using a classifier trained with the Support Vector M...

Full description

Saved in:
Bibliographic Details
Published inHCI International 2015 - Posters’ Extended Abstracts pp. 741 - 746
Main Authors Huang, Yuyun, Elias, Christy, Cabral, João P., Nautiyal, Atul, Saam, Christian, Campbell, Nick
Format Book Chapter
LanguageEnglish
Published Cham Springer International Publishing
SeriesCommunications in Computer and Information Science
Subjects
Engagement detection
Robot interaction
Visual analysis
Voice quality
Online AccessGet full text

Cover

More Information
Summary:In this paper we describe ongoing work to develop an engagement classifier for human-computer interaction systems. We have successfully classified group and individual engagement in a corpus of a conversation among four people called TableTalk, by using a classifier trained with the Support Vector Machine method and audio-visual features. The goal in this paper is to extend that work for the classification of engagement in videos of interaction between an human and a talking robot. For that purpose we are using a corpus of dialogues between participants and a Lego robot named Herme, which was collected during an exhibition. We describe the techniques to improve the engagement detection by taking into account the differences between the characteristics of the videos between the two datasets. Currently we are also conducting an experiment to manually annotate the Herme videos with engagement labels. These annotations will be used for evaluation and further improvements to engagement detection.
ISBN:3319213792
9783319213798
ISSN:1865-0929
1865-0937
DOI:10.1007/978-3-319-21380-4_125