Spearman Rank Correlation Screening for Ultrahigh-Dimensional Censored Data

Authors

  • Hongni Wang Shandong University of Finance and Economics
  • Jingxin Yan Academy of Mathematics and Systems Science, Chinese Academy of Sciences
  • Xiaodong Yan Zhongtai Securities Institute for Financial Studies, Shandong University Shandong Province Key Laboratory of Financial Risk Shandong National Center for Applied Mathematics

DOI:

https://doi.org/10.1609/aaai.v37i8.26204

Keywords:

ML: Dimensionality Reduction/Feature Selection, ML: Classification and Regression

Abstract

Herein, we propose a Spearman rank correlation-based screening procedure for ultrahigh-dimensional data with censored response cases. The proposed method is model-free without specifying any regression forms of predictors or response variables and is robust under the unknown monotone transformations of these response variable and predictors. The sure-screening and rank-consistency properties are established under some mild regularity conditions. Simulation studies demonstrate that the new screening method performs well in the presence of a heavy-tailed distribution, strongly dependent predictors or outliers, and offers superior performance over the existing nonparametric screening procedures. In particular, the new screening method still works well when a response variable is observed under a high censoring rate. An illustrative example is provided.

Downloads

Published

2023-06-26

How to Cite

Wang, H., Yan, J., & Yan, X. (2023). Spearman Rank Correlation Screening for Ultrahigh-Dimensional Censored Data. Proceedings of the AAAI Conference on Artificial Intelligence, 37(8), 10104-10112. https://doi.org/10.1609/aaai.v37i8.26204

Issue

Section

AAAI Technical Track on Machine Learning III