Centerless Multi-View K-means Based on the Adjacency Matrix

Authors

  • Han Lu School of Telecommunications Engineering, Xidian University, Xi'an 710071, P.R.China.
  • Quanxue Gao School of Telecommunications Engineering, Xidian University, Xi'an 710071, P.R.China.
  • Qianqian Wang School of Telecommunications Engineering, Xidian University, Xi'an 710071, P.R.China.
  • Ming Yang Mathematics department of the University of Evansville, Evansville, IN 47722 USA
  • Wei Xia School of Telecommunications Engineering, Xidian University, Xi'an 710071, P.R.China.

DOI:

https://doi.org/10.1609/aaai.v37i7.26075

Keywords:

ML: Clustering, ML: Matrix & Tensor Methods, ML: Multi-Instance/Multi-View Learning, ML: Unsupervised & Self-Supervised Learning

Abstract

Although K-Means clustering has been widely studied due to its simplicity, these methods still have the following fatal drawbacks. Firstly, they need to initialize the cluster centers, which causes unstable clustering performance. Secondly, they have poor performance on non-Gaussian datasets. Inspired by the affinity matrix, we propose a novel multi-view K-Means based on the adjacency matrix. It maps the affinity matrix to the distance matrix according to the principle that every sample has a small distance from the points in its neighborhood and a large distance from the points outside of the neighborhood. Moreover, this method well exploits the complementary information embedded in different views by minimizing the tensor Schatten p-norm regularize on the third-order tensor which consists of cluster assignment matrices of different views. Additionally, this method avoids initializing cluster centroids to obtain stable performance. And there is no need to compute the means of clusters so that our model is not sensitive to outliers. Experiment on a toy dataset shows the excellent performance on non-Gaussian datasets. And other experiments on several benchmark datasets demonstrate the superiority of our proposed method.

Downloads

Published

2023-06-26

How to Cite

Lu, H., Gao, Q., Wang, Q., Yang, M., & Xia, W. (2023). Centerless Multi-View K-means Based on the Adjacency Matrix. Proceedings of the AAAI Conference on Artificial Intelligence, 37(7), 8949-8956. https://doi.org/10.1609/aaai.v37i7.26075

Issue

Section

AAAI Technical Track on Machine Learning II