TY - JOUR AU - Li, Yuan AU - Li, Chunyuan AU - Zhang, Yizhe AU - Li, Xiujun AU - Zheng, Guoqing AU - Carin, Lawrence AU - Gao, Jianfeng PY - 2020/04/03 Y2 - 2024/03/19 TI - Complementary Auxiliary Classifiers for Label-Conditional Text Generation JF - Proceedings of the AAAI Conference on Artificial Intelligence JA - AAAI VL - 34 IS - 05 SE - AAAI Technical Track: Natural Language Processing DO - 10.1609/aaai.v34i05.6346 UR - https://ojs.aaai.org/index.php/AAAI/article/view/6346 SP - 8303-8310 AB - <p>Learning to generate text with a given label is a challenging task because natural language sentences are highly variable and ambiguous. It renders difficulties in trade-off between sentence quality and label fidelity. In this paper, we present CARA to alleviate the issue, where two auxiliary classifiers work simultaneously to ensure that (1) the encoder learns disentangled features and (2) the generator produces label-related sentences. Two practical techniques are further proposed to improve the performance, including annealing the learning signal from the auxiliary classifier, and enhancing the encoder with pre-trained language models. To establish a comprehensive benchmark fostering future research, we consider a suite of four datasets, and systematically reproduce three representative methods. CARA shows consistent improvement over the previous methods on the task of label-conditional text generation, and achieves state-of-the-art on the task of attribute transfer.</p> ER -