Rethinking Causal Relationships Learning in Graph Neural Networks

Authors

  • Hang Gao Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences
  • Chengyu Yao Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences
  • Jiangmeng Li Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences State Key Laboratory of Intelligent Game
  • Lingyu Si Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences
  • Yifan Jin Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences
  • Fengge Wu Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences
  • Changwen Zheng Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences
  • Huaping Liu Tsinghua University

DOI:

https://doi.org/10.1609/aaai.v38i11.29103

Keywords:

ML: Representation Learning, ML: Causal Learning, ML: Graph-based Machine Learning

Abstract

Graph Neural Networks (GNNs) demonstrate their significance by effectively modeling complex interrelationships within graph-structured data. To enhance the credibility and robustness of GNNs, it becomes exceptionally crucial to bolster their ability to capture causal relationships. However, despite recent advancements that have indeed strengthened GNNs from a causal learning perspective, conducting an in-depth analysis specifically targeting the causal modeling prowess of GNNs remains an unresolved issue. In order to comprehensively analyze various GNN models from a causal learning perspective, we constructed an artificially synthesized dataset with known and controllable causal relationships between data and labels. The rationality of the generated data is further ensured through theoretical foundations. Drawing insights from analyses conducted using our dataset, we introduce a lightweight and highly adaptable GNN module designed to strengthen GNNs' causal learning capabilities across a diverse range of tasks. Through a series of experiments conducted on both synthetic datasets and other real-world datasets, we empirically validate the effectiveness of the proposed module. The codes are available at https://github.com/yaoyao-yaoyao-cell/CRCG.

Published

2024-03-24

How to Cite

Gao, H., Yao, C., Li, J., Si, L., Jin, Y., Wu, F., Zheng, C., & Liu, H. (2024). Rethinking Causal Relationships Learning in Graph Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence, 38(11), 12145-12154. https://doi.org/10.1609/aaai.v38i11.29103

Issue

Section

AAAI Technical Track on Machine Learning II