Engagement Recognition from Listener’s Behaviors in Spoken Dialogue Using a Latent Character Model

This article addresses the estimation of engagement level based on the listener’s behaviors such as backchannel, laughing, head nodding, and eye-gaze. Engagement is defined as the level of how much a user is being interested in and willing to continue the current interaction. When the engagement lev...

Full description

Saved in:
Bibliographic Details
Published inTransactions of the Japanese Society for Artificial Intelligence Vol. 33; no. 1; pp. DSH-F_1 - 12
Main Authors Inoue, Koji, Divesh, Lala, Yoshii, Kazuyoshi, Takanashi, Katsuya, Kawahara, Tatsuya
Format Journal Article
LanguageJapanese
Published The Japanese Society for Artificial Intelligence 01.01.2018
Subjects
behavior
character
dialogue
engagement
latent model
Online AccessGet full text

Cover

More Information
Summary:This article addresses the estimation of engagement level based on the listener’s behaviors such as backchannel, laughing, head nodding, and eye-gaze. Engagement is defined as the level of how much a user is being interested in and willing to continue the current interaction. When the engagement level is evaluated by multiple annotators, the criteria for annotating the engagement level would depend on each annotator. We assume that each annotator has its own character which affects the way of perceiving the engagement level. We propose a latent character model which estimates the engagement level and also the character of each annotator as a latent variable. The experimental results show that the latent character model can predict the engagement label of each annotator in higher accuracy than other models which do not take the character into account.
ISSN:1346-0714
1346-8030
DOI:10.1527/tjsai.DSH-F