Developing Emotion-Aware Human–Robot Dialogues for Domain-Specific and Goal-Oriented Tasks

• Published in: Robotics (Basel) Vol. 9; no. 2; p. 31
• Main Authors: Huang, Jhih-Yuan, Lee, Wei-Po, Chen, Chen-Chia, Dong, Bu-Wei
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.06.2020
• Subjects: Cloud computing; Deep learning; dialogue modeling; emotion recognition; Emotions; human–machine interaction; Internet of Things; Machine learning; Mapping; Neural networks; Performance assessment; Questions; Researchers; Robotics; Robots; Service oriented architecture; service robot; Service robots; Software
• ISSN: 2218-6581; 2218-6581
• DOI: 10.3390/robotics9020031

Developing dialogue services for robots has been promoted nowadays for providing natural human–robot interactions to enhance user experiences. In this study, we adopted a service-oriented framework to develop emotion-aware dialogues for service robots. Considering the importance of the contexts and contents of dialogues in delivering robot services, our framework employed deep learning methods to develop emotion classifiers and two types of dialogue models of dialogue services. In the first type of dialogue service, the robot works as a consultant, able to provide domain-specific knowledge to users. We trained different neural models for mapping questions and answering sentences, tracking the human emotion during the human–robot dialogue, and using the emotion information to decide the responses. In the second type of dialogue service, the robot continuously asks the user questions related to a task with a specific goal, tracks the user’s intention through the interactions and provides suggestions accordingly. A series of experiments and performance comparisons were conducted to evaluate the major components of the presented framework and the results showed the promise of our approach.