Dialog State Tracking with Reinforced Data Augmentation


  • Yichun Yin Huawei Noah's Ark Lab
  • Lifeng Shang Huawei Noah's Ark Lab
  • Xin Jiang Huawei Noah's Ark Lab
  • Xiao Chen Huawei Noah's Ark Lab
  • Qun Liu Huawei Noah's Ark Lab




Neural dialog state trackers are generally limited due to the lack of quantity and diversity of annotated training data. In this paper, we address this difficulty by proposing a reinforcement learning (RL) based framework for data augmentation that can generate high-quality data to improve the neural state tracker. Specifically, we introduce a novel contextual bandit generator to learn fine-grained augmentation policies that can generate new effective instances by choosing suitable replacements for specific context. Moreover, by alternately learning between the generator and the state tracker, we can keep refining the generative policies to generate more high-quality training data for neural state tracker. Experimental results on the WoZ and MultiWoZ (restaurant) datasets demonstrate that the proposed framework significantly improves the performance over the state-of-the-art models, especially with limited training data.




How to Cite

Yin, Y., Shang, L., Jiang, X., Chen, X., & Liu, Q. (2020). Dialog State Tracking with Reinforced Data Augmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05), 9474-9481. https://doi.org/10.1609/aaai.v34i05.6491



AAAI Technical Track: Natural Language Processing