GSSNN: Graph Smoothing Splines Neural Networks

Authors

  • Shichao Zhu Institute of Information Engineering, Chinese Academy of Sciences
  • Lewei Zhou Chinese Academy of Sciences
  • Shirui Pan Monash University
  • Chuan Zhou Chinese Academy of Sciences
  • Guiying Yan Chinese Academy of Sciences
  • Bin Wang Xiaomi AI Lab

DOI:

https://doi.org/10.1609/aaai.v34i04.6185

Abstract

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in many graph data analysis tasks. However, they still suffer from two limitations for graph representation learning. First, they exploit non-smoothing node features which may result in suboptimal embedding and degenerated performance for graph classification. Second, they only exploit neighbor information but ignore global topological knowledge. Aiming to overcome these limitations simultaneously, in this paper, we propose a novel, flexible, and end-to-end framework, Graph Smoothing Splines Neural Networks (GSSNN), for graph classification. By exploiting the smoothing splines, which are widely used to learn smoothing fitting function in regression, we develop an effective feature smoothing and enhancement module Scaled Smoothing Splines (S3) to learn graph embedding. To integrate global topological information, we design a novel scoring module, which exploits closeness, degree, as well as self-attention values, to select important node features as knots for smoothing splines. These knots can be potentially used for interpreting classification results. In extensive experiments on biological and social datasets, we demonstrate that our model achieves state-of-the-arts and GSSNN is superior in learning more robust graph representations. Furthermore, we show that S3 module is easily plugged into existing GNNs to improve their performance.

Downloads

Published

2020-04-03

How to Cite

Zhu, S., Zhou, L., Pan, S., Zhou, C., Yan, G., & Wang, B. (2020). GSSNN: Graph Smoothing Splines Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence, 34(04), 7007-7014. https://doi.org/10.1609/aaai.v34i04.6185

Issue

Section

AAAI Technical Track: Machine Learning