TY - JOUR AU - Ming, Di AU - Ding, Chris AU - Nie, Feiping PY - 2019/07/17 Y2 - 2024/03/28 TI - A Probabilistic Derivation of LASSO and L12-Norm Feature Selections JF - Proceedings of the AAAI Conference on Artificial Intelligence JA - AAAI VL - 33 IS - 01 SE - AAAI Technical Track: Machine Learning DO - 10.1609/aaai.v33i01.33014586 UR - https://ojs.aaai.org/index.php/AAAI/article/view/4382 SP - 4586-4593 AB - <p>LASSO and ℓ<sub>2<em>,</em>1</sub>-norm based feature selection had achieved success in many application areas. In this paper, we first derive LASSO and ℓ<sub>1<em>,</em>2</sub>-norm feature selection from a probabilistic framework, which provides an independent point of view from the usual sparse coding point of view. From here, we further propose a feature selection approach based on the probability-derived ℓ<sub>1<em>,</em>2</sub>-norm. We point out some inflexibility in the standard feature selection that the feature selected for all different classes are enforced to be exactly the same using the widely used ℓ<sub>2<em>,</em>1</sub>-norm, which enforces the joint sparsity across all the data instances. Using the probabilityderived ℓ<sub>1<em>,</em>2</sub>-norm feature selection, allowing certain flexibility that the selected features do not have to be exactly same for all classes, the resulting features lead to better classification on six benchmark datasets.</p> ER -