A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-oriented Dialogue Policy Learning

• Published in: International journal of automation and computing Vol. 20; no. 3; pp. 318 - 334
• Main Authors: Kwan, Wai-Chung, Wang, Hong-Ru, Wang, Hui-Min, Wong, Kam-Fai
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.06.2023; Springer Nature B.V
• Subjects: Airlines; Algorithms; Artificial Intelligence; Computer Science; Interactive computer systems; Language; Machine learning; Markov analysis; Natural language; Natural language processing; Review; Teaching methods; Dialogue policy learning (DPL); Markov decision process; task-oriented dialogue system (TOD); dialogue system; reinforcement learning (RL)
• ISSN: 2731-538X; 1476-8186; 2153-182X; 2731-5398; 1751-8520; 2153-1838
• DOI: 10.1007/s11633-022-1347-y

Dialogue policy learning (DPL) is a key component in a task-oriented dialogue (TOD) system. Its goal is to decide the next action of the dialogue system, given the dialogue state at each turn based on a learned dialogue policy. Reinforcement learning (RL) is widely used to optimize this dialogue policy. In the learning process, the user is regarded as the environment and the system as the agent. In this paper, we present an overview of the recent advances and challenges in dialogue policy from the perspective of RL. More specifically, we identify the problems and summarize corresponding solutions for RL-based dialogue policy learning. In addition, we provide a comprehensive survey of applying RL to DPL by categorizing recent methods into five basic elements in RL. We believe this survey can shed light on future research in DPL.