Active Learning with Query Generation for Cost-Effective Text Classification

Authors

  • Yi-Fan Yan NUAA
  • Sheng-Jun Huang NUAA
  • Shaoyi Chen Tencent Inc.
  • Meng Liao Tencent Inc.
  • Jin Xu Tencent Inc.

DOI:

https://doi.org/10.1609/aaai.v34i04.6133

Abstract

Labeling a text document is usually time consuming because it requires the annotator to read the whole document and check its relevance with each possible class label. It thus becomes rather expensive to train an effective model for text classification when it involves a large dataset of long documents. In this paper, we propose an active learning approach for text classification with lower annotation cost. Instead of scanning all the examples in the unlabeled data pool to select the best one for query, the proposed method automatically generates the most informative examples based on the classification model, and thus can be applied to tasks with large scale or even infinite unlabeled data. Furthermore, we propose to approximate the generated example with a few summary words by sparse reconstruction, which allows the annotators to easily assign the class label by reading a few words rather than the long document. Experiments on different datasets demonstrate that the proposed approach can effectively improve the classification performance while significantly reduce the annotation cost.

Downloads

Published

2020-04-03

How to Cite

Yan, Y.-F., Huang, S.-J., Chen, S., Liao, M., & Xu, J. (2020). Active Learning with Query Generation for Cost-Effective Text Classification. Proceedings of the AAAI Conference on Artificial Intelligence, 34(04), 6583-6590. https://doi.org/10.1609/aaai.v34i04.6133

Issue

Section

AAAI Technical Track: Machine Learning