Deep Copula-Based Survival Analysis for Dependent Censoring with Identifiability Guarantees

Authors

  • Weijia Zhang The University of Newcastle
  • Chun Kai Ling Carnegie Mellon University
  • Xuanhui Zhang Nanjing University

DOI:

https://doi.org/10.1609/aaai.v38i18.30047

Keywords:

RU: Probabilistic Inference, ML: Classification and Regression, ML: Applications, APP: Humanities & Computational Social Science

Abstract

Censoring is the central problem in survival analysis where either the time-to-event (for instance, death), or the time-to censoring (such as loss of follow-up) is observed for each sample. The majority of existing machine learning-based survival analysis methods assume that survival is conditionally independent of censoring given a set of covariates; an assumption that cannot be verified since only marginal distributions is available from the data. The existence of dependent censoring, along with the inherent bias in current estimators has been demonstrated in a variety of applications, accentuating the need for a more nuanced approach. However, existing methods that adjust for dependent censoring require practitioners to specify the ground truth copula. This requirement poses a significant challenge for practical applications, as model misspecification can lead to substantial bias. In this work, we propose a flexible deep learning-based survival analysis method that simultaneously accommodate for dependent censoring and eliminates the requirement for specifying the ground truth copula. We theoretically prove the identifiability of our model under a broad family of copulas and survival distributions. Experiments results from a wide range of datasets demonstrate that our approach successfully discerns the underlying dependency structure and significantly reduces survival estimation bias when compared to existing methods.

Published

2024-03-24

How to Cite

Zhang, W., Ling, C. K., & Zhang, X. (2024). Deep Copula-Based Survival Analysis for Dependent Censoring with Identifiability Guarantees. Proceedings of the AAAI Conference on Artificial Intelligence, 38(18), 20613-20621. https://doi.org/10.1609/aaai.v38i18.30047

Issue

Section

AAAI Technical Track on Reasoning under Uncertainty