Advances and Challenges in Multi-Domain Task-Oriented Dialogue Policy Optimization

Abstract

Developing a successful dialogue policy for a multi-domain task-oriented dialogue (MDTD) system is a challenging task. Basically, a desirable dialogue policy acts as the decision-making agent who understands the user’s intention to provide suitable responses within a short conversation. Furthermore, offering the precise answers to satisfy the user requirements makes the task even more challenging. This paper surveys recent advances in multi-domain task-oriented dialogue policy optimization and summarizes a number of solutions to policy learning. In particular, the case study on the task of travel assistance using the MDTD dataset based on MultiWOZ containing seven different domains is investigated. The dialogue policy optimization methods, categorized into dialogue act level and word level, are systematically presented. Moreover, this paper addresses a number of challenges and difficulties including the user simulator design and the dialogue policy evaluation which need to be resolved to further enhance the robustness and effectiveness in multi-domain dialogue policy representation. ∗Corresponding author: Jen-Tzung Chien, jtchien@nycu.edu.tw. Received 22 May 2023; Revised 20 July 2023 ISSN 2048-7703; DOI 10.1561/116.00000132 © 2023 M. Rohmatillah and J.-T. Chien 2 Rohmatillah and Chien