Contextualized Rewriting for Text Summarization


  • Guangsheng Bao Westlake University
  • Yue Zhang Westlake University


Summarization, Generation


Extractive summarization suffers from irrelevance, redundancy and incoherence. Existing work shows that abstractive rewriting for extractive summaries can improve the conciseness and readability. These rewriting systems consider extracted summaries as the only input, which is relatively focused but can lose important background knowledge. In this paper, we investigate contextualized rewriting, which ingests the entire original document. We formalize contextualized rewriting as a seq2seq problem with group alignments, introducing group tag as a solution to model the alignments, identifying extracted summaries through content-based addressing. Results show that our approach significantly outperforms non-contextualized rewriting systems without requiring reinforcement learning, achieving strong improvements on ROUGE scores upon multiple extractive summarizers.




How to Cite

Bao, G., & Zhang, Y. (2021). Contextualized Rewriting for Text Summarization. Proceedings of the AAAI Conference on Artificial Intelligence, 35(14), 12544-12553. Retrieved from



AAAI Technical Track on Speech and Natural Language Processing I