Structural Entropy Guided Incremental Learning for Open-World Multimodal Social Event Detection

Authors

  • Zhiwei Yang Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China
  • Haimei Qin Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
  • Xiaoyan Yu Beijing Institute of Technology, Beijing, China
  • Hao Peng Beihang University, Beijing, China
  • Lei Jiang Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
  • Li Sun North China Electric Power University, Beijing, China
  • Zhiqin Yang The Chinese University of Hong Kong, Hong Kong, China

DOI:

https://doi.org/10.1609/aaai.v40i19.38647

Abstract

With the explosive growth of multimodal data streams on social media, the timely detection of emerging social events has become increasingly important. As a result, Multimodal Social Event Detection in open-world settings is receiving growing attention. However, most existing methods face two major limitations: (1) They overlook the dynamic nature of open-world social media data and fail to design dedicated incremental learning frameworks. (2) They ignore the impact of noise in streaming data, leading to performance degradation over long-term detection. To overcome these limitations, we propose SeInEvent (**S**tructural **E**ntropy Guided **In**cremental Learning for Open-World Multimodal Social **Event** Detection). Our innovations are as follows: **First**, considering data dynamics, we design a self-supervised alternating incremental contrastive learning mechanism. Through knowledge distillation, historical event clusters were reviewed and consolidated, and contrastive learning was combined to absorb knowledge of unknown events, ultimately achieving incremental learning without labels. **Second**, addressing the impact of noise, we propose a Pointwise Structural Entropy-based noise filter, which quantifies each sample’s informational contribution to the event clustering structure. It enables automatic removal of noisy data and supports robust long-term detection. Extensive experiments on two public datasets demonstrate that SeInEvent achieves superior performance.

Downloads

Published

2026-03-14

How to Cite

Yang, Z., Qin, H., Yu, X., Peng, H., Jiang, L., Sun, L., & Yang, Z. (2026). Structural Entropy Guided Incremental Learning for Open-World Multimodal Social Event Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 40(19), 16119–16127. https://doi.org/10.1609/aaai.v40i19.38647

Issue

Section

AAAI Technical Track on Data Mining & Knowledge Management III