Unsupervised Paraphrasing under Syntax Knowledge


  • Tianyuan Liu Shandong University
  • Yuqing Sun Shandong University
  • Jiaqi Wu Shandong University
  • Xi Xu Shandong University
  • Yuchen Han Shandong University
  • Cheng Li Shandong University
  • Bin Gong Shandong University




SNLP: Generation, SNLP: Other Foundations of Speech & Natural Language Processing


The soundness of syntax is an important issue for the paraphrase generation task. Most methods control the syntax of paraphrases by embedding the syntax and semantics in the generation process, which cannot guarantee the syntactical correctness of the results. Different from them, in this paper we investigate the structural patterns of word usages termed as the word composable knowledge and integrate it into the paraphrase generation to control the syntax in an explicit way. This syntax knowledge is pretrained on a large corpus with the dependency relationships and formed as the probabilistic functions on the word-level syntactical soundness. For the sentence-level correctness, we design a hierarchical syntax structure loss to quantitatively verify the syntactical soundness of the paraphrase against the given dependency template. Thus, the generation process can select the appropriate words with consideration on both semantics and syntax. The proposed method is evaluated on a few paraphrase datasets. The experimental results show that the quality of paraphrases by our proposed method outperforms the compared methods, especially in terms of syntax correctness.




How to Cite

Liu, T., Sun, Y., Wu, J., Xu, X., Han, Y., Li, C., & Gong, B. (2023). Unsupervised Paraphrasing under Syntax Knowledge. Proceedings of the AAAI Conference on Artificial Intelligence, 37(11), 13273-13281. https://doi.org/10.1609/aaai.v37i11.26558



AAAI Technical Track on Speech & Natural Language Processing