Globally and Locally Consistent Unsupervised Projection

Authors

  • Hua Wang Colorado School of Mines
  • Feiping Nie University of Texas at Arlington
  • Heng Huang University of Texas at Arlington

DOI:

https://doi.org/10.1609/aaai.v28i1.8915

Keywords:

Unsupervised Dimensionality Reduction

Abstract

In this paper, we propose an unsupervised projection method for feature extraction to preserve both global and local consistencies of the input data in the projected space. Traditional unsupervised feature extraction methods, such as principal component analysis (PCA) and locality preserving projections (LPP), can only explore either the global or local geometric structures of the input data, but not the both at the same time. In our new method, we introduce a new measurement using the neighborhood data variances to assess the data locality, by which we propose to learn an optimal projection by rewarding both the global and local structures of the input data. The formulated optimization problem is challenging to solve, because it ends up a trace ratio minimization problem. In this paper, as an important theoretical contribution, we propose a simple yet efficient optimization algorithm to solve the trace ratio problem with theoretically proved convergence. Extensive experiments have been performed on six benchmark data sets, where the promising results validate the proposed method.

Downloads

Published

2014-06-21

How to Cite

Wang, H., Nie, F., & Huang, H. (2014). Globally and Locally Consistent Unsupervised Projection. Proceedings of the AAAI Conference on Artificial Intelligence, 28(1). https://doi.org/10.1609/aaai.v28i1.8915

Issue

Section

Main Track: Machine Learning Applications