Survival Prediction via Deep Attention-Based Multiple-Instance Learning Networks with Instance Sampling

Authors

  • Aliasghar Tarkhan Department of Biostatistics, University of Washington, Seattle, WA, USA
  • Trung Kien Nguyen Imaging and Personalized Healthcare Group, Genentech Inc., South San Francisco, CA, USA
  • Noah Simon Department of Biostatistics, University of Washington, Seattle, WA, USA
  • Jian Dai Imaging and Personalized Healthcare Group, Genentech Inc., South San Francisco, CA, USA

DOI:

https://doi.org/10.1609/aaaiss.v2i1.27717

Keywords:

Survival Prediction, Deep Neural Network, Attention Network, Multiple-instance Learning, Instance Sampling, Computation Complexity

Abstract

Survival prediction via training deep neural networks with giga-pixel whole-slide images (WSIs) is challenging due to the lack of time annotation at the pixel level or patch (instance). Multiple instance learning (MIL), as a typical weakly supervised learning method, aims to resolve this challenge by using only the slide-level time. The attention-based MIL method leverages and enhances performance by weighting the instances based on their contribution to predicting the outcome. A WSI typically contains hundreds of thousands of image patches. Training a deep neural network with thousands of image patches per slide is computationally expensive and time-consuming. To tackle this issue, we propose an adaptive-learning strategy where we sample a subset of informative instances/patches more often to train the deep survival neural networks. We also present other sampling strategies and compare them with our proposed sampling strategy. Using both real-world and synthesized WSIs for survival, we show that sampling strategies significantly can significantly reduce computing time while result in no or negligible performance loss. We also discuss the benefits of each instance sampling strategy in different scenarios.

Downloads

Published

2024-01-22

Issue

Section

Second Symposium on Survival Prediction: Algorithms, Challenges, and Applications (SPACA)