Towards Effective and General Graph Unlearning via Mutual Evolution

Authors

  • Xunkai Li Beijing Institute of Technology
  • Yulin Zhao Shandong University
  • Zhengyu Wu Beijing Institute of Technology
  • Wentao Zhang Peking University National Engineering Labratory for Big Data Analytics and Applications
  • Rong-Hua Li Beijing Institute of Technology Shenzhen Institute of Technology
  • Guoren Wang Beijing Institute of Technology

DOI:

https://doi.org/10.1609/aaai.v38i12.29273

Keywords:

ML: Graph-based Machine Learning, ML: Deep Learning Algorithms, ML: Semi-Supervised Learning, ML: Privacy

Abstract

With the rapid advancement of AI applications, the growing needs for data privacy and model robustness have highlighted the importance of machine unlearning, especially in thriving graph-based scenarios. However, most existing graph unlearning strategies primarily rely on well-designed architectures or manual process, rendering them less user-friendly and posing challenges in terms of deployment efficiency. Furthermore, striking a balance between unlearning performance and framework generalization is also a pivotal concern. To address the above issues, we propose Mutual Evolution Graph Unlearning (MEGU), a new mutual evolution paradigm that simultaneously evolves the predictive and unlearning capacities of graph unlearning. By incorporating aforementioned two components, MEGU ensures complementary optimization in a unified training framework that aligns with the prediction and unlearning requirements. Extensive experiments on 9 graph benchmark datasets demonstrate the superior performance of MEGU in addressing unlearning requirements at the feature, node, and edge levels. Specifically, MEGU achieves average performance improvements of 2.7%, 2.5%, and 3.2% across these three levels of unlearning tasks when compared to state-of-the-art baselines. Furthermore, MEGU exhibits satisfactory training efficiency, reducing time and space overhead by an average of 159.8x and 9.6x, respectively, in comparison to retraining GNN from scratch.

Published

2024-03-24

How to Cite

Li, X., Zhao, Y., Wu, Z., Zhang, W., Li, R.-H., & Wang, G. (2024). Towards Effective and General Graph Unlearning via Mutual Evolution. Proceedings of the AAAI Conference on Artificial Intelligence, 38(12), 13682-13690. https://doi.org/10.1609/aaai.v38i12.29273

Issue

Section

AAAI Technical Track on Machine Learning III