Provably Powerful Graph Neural Networks for Directed Multigraphs

Authors

  • Béni Egressy ETH Zurich, Zurich, Switzerland IBM Research Europe, Zurich, Switzerland
  • Luc von Niederhäusern ETH Zurich, Zurich, Switzerland IBM Research Europe, Zurich, Switzerland
  • Jovan Blanuša IBM Research Europe, Zurich, Switzerland
  • Erik Altman IBM Watson Research, Yorktown Heights, NY, USA
  • Roger Wattenhofer ETH Zurich, Zurich, Switzerland
  • Kubilay Atasu IBM Research Europe, Zurich, Switzerland

DOI:

https://doi.org/10.1609/aaai.v38i10.29069

Keywords:

ML: Graph-based Machine Learning, ML: Applications, APP: Other Applications

Abstract

This paper analyses a set of simple adaptations that transform standard message-passing Graph Neural Networks (GNN) into provably powerful directed multigraph neural networks. The adaptations include multigraph port numbering, ego IDs, and reverse message passing. We prove that the combination of these theoretically enables the detection of any directed subgraph pattern. To validate the effectiveness of our proposed adaptations in practice, we conduct experiments on synthetic subgraph detection tasks, which demonstrate outstanding performance with almost perfect results. Moreover, we apply our proposed adaptations to two financial crime analysis tasks. We observe dramatic improvements in detecting money laundering transactions, improving the minority-class F1 score of a standard message-passing GNN by up to 30%, and closely matching or outperforming tree-based and GNN baselines. Similarly impressive results are observed on a real-world phishing detection dataset, boosting three standard GNNs’ F1 scores by around 15% and outperforming all baselines. An extended version with appendices can be found on arXiv: https://arxiv.org/abs/2306.11586.

Published

2024-03-24

How to Cite

Egressy, B., von Niederhäusern, L., Blanuša, J., Altman, E., Wattenhofer, R., & Atasu, K. (2024). Provably Powerful Graph Neural Networks for Directed Multigraphs. Proceedings of the AAAI Conference on Artificial Intelligence, 38(10), 11838-11846. https://doi.org/10.1609/aaai.v38i10.29069

Issue

Section

AAAI Technical Track on Machine Learning I