CoCoS: Enhancing Semi-supervised Learning on Graphs with Unlabeled Data via Contrastive Context Sharing

Authors

  • Siyue Xie The Chinese University of Hongkong
  • Da Sun Handason Tam The Chinese University of Hongkong
  • Wing Cheong Lau The Chinese University of Hong Kong

DOI:

https://doi.org/10.1609/aaai.v36i4.20347

Keywords:

Data Mining & Knowledge Management (DMKM), Machine Learning (ML), Knowledge Representation And Reasoning (KRR)

Abstract

Graph Neural Networks (GNNs) have recently become a popular framework for semi-supervised learning on graph-structured data. However, typical GNN models heavily rely on labeled data in the learning process, while ignoring or paying little attention to the data that are unlabeled but available. To make full use of available data, we propose a generic framework, Contrastive Context Sharing (CoCoS), to enhance the learning capacity of GNNs for semi-supervised tasks. By sharing the contextual information among nodes estimated to be in the same class, different nodes can be correlated even if they are unlabeled and remote from each other in the graph. Models can therefore learn different combinations of contextual patterns, which improves the robustness of node representations. Additionally, motivated by recent advances in self-supervised learning, we augment the context sharing strategy by integrating with contrastive learning, which naturally correlates intra-class and inter-class data. Such operations utilize all available data for training and effectively improve a model's learning capacity. CoCoS can be easily extended to a wide range of GNN-based models with little computational overheads. Extensive experiments show that CoCoS considerably enhances typical GNN models, especially when labeled data are sparse in a graph, and achieves state-of-the-art or competitive results in real-world public datasets. The code of CoCoS is available online.

Downloads

Published

2022-06-28

How to Cite

Xie, S., Tam, D. S. H., & Lau, W. C. (2022). CoCoS: Enhancing Semi-supervised Learning on Graphs with Unlabeled Data via Contrastive Context Sharing. Proceedings of the AAAI Conference on Artificial Intelligence, 36(4), 4272-4280. https://doi.org/10.1609/aaai.v36i4.20347

Issue

Section

AAAI Technical Track on Data Mining and Knowledge Management