Enumerate Lasso Solutions for Feature Selection

Authors

  • Satoshi Hara National Institute of Informatics
  • Takanori Maehara Shizuoka University

DOI:

https://doi.org/10.1609/aaai.v31i1.10793

Abstract

We propose an algorithm for enumerating solutions to the Lasso regression problem.In ordinary Lasso regression, one global optimum is obtained and the resulting features are interpreted as task-relevant features.However, this can overlook possibly relevant features not selected by the Lasso.With the proposed method, we can enumerate many possible feature sets for human inspection, thus recording all the important features.We prove that by enumerating solutions, we can recover a true feature set exactly under less restrictive conditions compared with the ordinary Lasso.We confirm our theoretical results also in numerical simulations.Finally, in the gene expression and the text data, we demonstrate that the proposed method can enumerate a wide variety of meaningful feature sets, which are overlooked by the global optima.

Downloads

Published

2017-02-13

How to Cite

Hara, S., & Maehara, T. (2017). Enumerate Lasso Solutions for Feature Selection. Proceedings of the AAAI Conference on Artificial Intelligence, 31(1). https://doi.org/10.1609/aaai.v31i1.10793