Selecting Optimal Context Sentences for Event-Event Relation Extraction


  • Hieu Man VinAI Research, Vietnam
  • Nghia Trung Ngo VinAI Research, Vietnam
  • Linh Ngo Van Hanoi University of Science and Technology, Vietnam
  • Thien Huu Nguyen Department of Computer and Information Science, University of Oregon, USA



Speech & Natural Language Processing (SNLP)


Understanding events entails recognizing the structural and temporal orders between event mentions to build event structures/graphs for input documents. To achieve this goal, our work addresses the problems of subevent relation extraction (SRE) and temporal event relation extraction (TRE) that aim to predict subevent and temporal relations between two given event mentions/triggers in texts. Recent state-of-the-art methods for such problems have employed transformer-based language models (e.g., BERT) to induce effective contextual representations for input event mention pairs. However, a major limitation of existing transformer-based models for SRE and TRE is that they can only encode input texts of limited length (i.e., up to 512 sub-tokens in BERT), thus unable to effectively capture important context sentences that are farther away in the documents. In this work, we introduce a novel method to better model document-level context with important context sentences for event-event relation extraction. Our method seeks to identify the most important context sentences for a given entity mention pair in a document and pack them into shorter documents to be consume entirely by transformer-based language models for representation learning. The REINFORCE algorithm is employed to train models where novel reward functions are presented to capture model performance, and context-based and knowledge-based similarity between sentences for our problem. Extensive experiments demonstrate the effectiveness of the proposed method with state-of-the-art performance on benchmark datasets.




How to Cite

Man, H., Ngo, N. T., Van, L. N., & Nguyen, T. . H. (2022). Selecting Optimal Context Sentences for Event-Event Relation Extraction. Proceedings of the AAAI Conference on Artificial Intelligence, 36(10), 11058-11066.



AAAI Technical Track on Speech and Natural Language Processing