Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning

Authors

  • Jiashun Cheng The Hong Kong University of Science and Technology
  • Man Li The Hong Kong University of Science and Technology
  • Jia Li The Hong Kong University of Science and Technology (Guangzhou) The Hong Kong University of Science and Technology
  • Fugee Tsung The Hong Kong University of Science and Technology (Guangzhou) The Hong Kong University of Science and Technology

DOI:

https://doi.org/10.1609/aaai.v37i6.25870

Keywords:

ML: Graph-based Machine Learning, ML: Unsupervised & Self-Supervised Learning

Abstract

Graph self-supervised learning (SSL) has been vastly employed to learn representations from unlabeled graphs. Existing methods can be roughly divided into predictive learning and contrastive learning, where the latter one attracts more research attention with better empirical performance. We argue that, however, predictive models weaponed with powerful decoder could achieve comparable or even better representation power than contrastive models. In this work, we propose a Wiener Graph Deconvolutional Network (WGDN), an augmentation-adaptive decoder empowered by graph wiener filter to perform information reconstruction. Theoretical analysis proves the superior reconstruction ability of graph wiener filter. Extensive experimental results on various datasets demonstrate the effectiveness of our approach.

Downloads

Published

2023-06-26

How to Cite

Cheng, J., Li, M., Li, J., & Tsung, F. (2023). Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 37(6), 7131-7139. https://doi.org/10.1609/aaai.v37i6.25870

Issue

Section

AAAI Technical Track on Machine Learning I