Contextualized Rewriting for Text Summarization
AbstractExtractive summarization suffers from irrelevance, redundancy and incoherence. Existing work shows that abstractive rewriting for extractive summaries can improve the conciseness and readability. These rewriting systems consider extracted summaries as the only input, which is relatively focused but can lose important background knowledge. In this paper, we investigate contextualized rewriting, which ingests the entire original document. We formalize contextualized rewriting as a seq2seq problem with group alignments, introducing group tag as a solution to model the alignments, identifying extracted summaries through content-based addressing. Results show that our approach significantly outperforms non-contextualized rewriting systems without requiring reinforcement learning, achieving strong improvements on ROUGE scores upon multiple extractive summarizers.
How to Cite
Bao, G., & Zhang, Y. (2021). Contextualized Rewriting for Text Summarization. Proceedings of the AAAI Conference on Artificial Intelligence, 35(14), 12544-12553. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/17487
AAAI Technical Track on Speech and Natural Language Processing I