Towards Evidential and Class Separable Open Set Object Detection

Authors

  • Ruofan Wang School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai
  • Rui-Wei Zhao Academy for Engineering and Technology, Fudan University, Shanghai
  • Xiaobo Zhang Children’s Hospital of Fudan University, National Children’s Medical Center, Shanghai, China
  • Rui Feng School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai Academy for Engineering and Technology, Fudan University, Shanghai Children’s Hospital of Fudan University, National Children’s Medical Center, Shanghai, China Shanghai Collaborative Innovation Center of Intelligent Visual Computing

DOI:

https://doi.org/10.1609/aaai.v38i6.28367

Keywords:

CV: Object Detection & Categorization, CV: Adversarial Attacks & Robustness

Abstract

Detecting in open-world scenarios poses a formidable challenge for models intended for real-world deployment. The advanced closed set object detectors achieve impressive performance under the closed set setting, but often produce overconfident misprediction on unknown objects due to the lack of supervision. In this paper, we propose a novel Evidential Object Detector (EOD) to formulate the Open Set Object Detection (OSOD) problem from the perspective of Evidential Deep Learning (EDL) theory, which quantifies classification uncertainty by placing the Dirichlet Prior over the categorical distribution parameters. The task-specific customized evidential framework, equipped with meticulously designed model architecture and loss function, effectively bridges the gap between EDL theory and detection tasks. Moreover, we utilize contrastive learning as an implicit means of evidential regularization and to encourage the class separation in the latent space. Alongside, we innovatively model the background uncertainty to further improve the unknown discovery ability. Extensive experiments on benchmark datasets demonstrate the outperformance of the proposed method over existing ones.

Downloads

Published

2024-03-24

How to Cite

Wang, R., Zhao, R.-W., Zhang, X., & Feng, R. (2024). Towards Evidential and Class Separable Open Set Object Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 38(6), 5572–5580. https://doi.org/10.1609/aaai.v38i6.28367

Issue

Section

AAAI Technical Track on Computer Vision V