TY - JOUR AU - Gao, Cuixia AU - Wang, Naiyan AU - Yu, Qi AU - Zhang, Zhihua PY - 2011/08/04 Y2 - 2024/03/29 TI - A Feasible Nonconvex Relaxation Approach to Feature Selection JF - Proceedings of the AAAI Conference on Artificial Intelligence JA - AAAI VL - 25 IS - 1 SE - AAAI Technical Track: Machine Learning DO - 10.1609/aaai.v25i1.7921 UR - https://ojs.aaai.org/index.php/AAAI/article/view/7921 SP - 356-361 AB - <p> Variable selection problems are typically addressed under apenalized optimization framework. Nonconvex penalties such as the minimax concave plus (MCP) and smoothly clipped absolute deviation(SCAD), have been demonstrated to have the properties of sparsity practically and theoretically. In this paper we propose a new nonconvex penalty that we call exponential-type penalty. The exponential-type penalty is characterized by a positive parameter,which establishes a connection with the ell<sub>0</sub> and ell<sub>1</sub> penalties.We apply this new penalty to sparse supervised learning problems. To solve to resulting optimization problem, we resort to a reweighted ell<sub>1</sub> minimization method. Moreover, we devise an efficient method for the adaptive update of the tuning parameter. Our experimental results are encouraging. They show that the exponential-type penalty is competitive with MCP and SCAD. </p> ER -