Automated Clustering of High-dimensional Data with a Feature Weighted Mean Shift Algorithm

Authors

  • Saptarshi Chakraborty University of California, Berkeley
  • Debolina Paul Indian Statistical Institute
  • Swagatam Das Indian Statistical Institute

Keywords:

Clustering

Abstract

Mean shift is a simple interactive procedure that gradually shifts data points towards the mode which denotes the highest density of data points in the region. Mean shift algorithms have been effectively used for data denoising, mode seeking, and finding the number of clusters in a dataset in an automated fashion. However, the merits of mean shift quickly fade away as the data dimensions increase and only a handful of features contain useful information about the cluster structure of the data. We propose a simple yet elegant feature-weighted variant of mean shift to efficiently learn the feature importance and thus, extending the merits of mean shift to high-dimensional data. The resulting algorithm not only outperforms the conventional mean shift clustering procedure but also preserves its computational simplicity. In addition, the proposed method comes with rigorous theoretical convergence guarantees and a convergence rate of at least a cubic order. The efficacy of our proposal is thoroughly assessed through experimental comparison against baseline and state-of-the-art clustering methods on synthetic as well as real-world datasets.

Downloads

Published

2021-05-18

How to Cite

Chakraborty, S., Paul, D., & Das, S. (2021). Automated Clustering of High-dimensional Data with a Feature Weighted Mean Shift Algorithm. Proceedings of the AAAI Conference on Artificial Intelligence, 35(8), 6930-6938. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/16854

Issue

Section

AAAI Technical Track on Machine Learning I