ANEDL: Adaptive Negative Evidential Deep Learning for Open-Set Semi-supervised Learning

Authors

  • Yang Yu The Chinese University of Hong Kong
  • Danruo Deng The Chinese University of Hong Kong
  • Furui Liu Zhejiang Lab
  • Qi Dou The Chinese University of Hong Kong
  • Yueming Jin National University of Singapore
  • Guangyong Chen Zhejiang Lab
  • Pheng Ann Heng The Chinese University of Hong Kong

DOI:

https://doi.org/10.1609/aaai.v38i15.29597

Keywords:

ML: Semi-Supervised Learning, ML: Calibration & Uncertainty Quantification

Abstract

Semi-supervised learning (SSL) methods assume that labeled data, unlabeled data and test data are from the same distribution. Open-set semi-supervised learning (Open-set SSL) con- siders a more practical scenario, where unlabeled data and test data contain new categories (outliers) not observed in labeled data (inliers). Most previous works focused on out- lier detection via binary classifiers, which suffer from insufficient scalability and inability to distinguish different types of uncertainty. In this paper, we propose a novel framework, Adaptive Negative Evidential Deep Learning (ANEDL) to tackle these limitations. Concretely, we first introduce evidential deep learning (EDL) as an outlier detector to quantify different types of uncertainty, and design different uncertainty metrics for self-training and inference. Furthermore, we propose a novel adaptive negative optimization strategy, making EDL more tailored to the unlabeled dataset containing both inliers and outliers. As demonstrated empirically, our proposed method outperforms existing state-of-the-art methods across four datasets.

Published

2024-03-24

How to Cite

Yu, Y., Deng, D., Liu, F., Dou, Q., Jin, Y., Chen, G., & Heng, P. A. (2024). ANEDL: Adaptive Negative Evidential Deep Learning for Open-Set Semi-supervised Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 38(15), 16587-16595. https://doi.org/10.1609/aaai.v38i15.29597

Issue

Section

AAAI Technical Track on Machine Learning VI