Learning Context-Aware Classifier for Semantic Segmentation


  • Zhuotao Tian SmartMore Chinese University of Hong Kong
  • Jiequan Cui Chinese University of Hong Kong
  • Li Jiang Max Planck Institute for Informatics
  • Xiaojuan Qi The University of Hong Kong
  • Xin Lai The Chinese University of Hong Kong
  • Yixin Chen Chinese University of Hong Kong
  • Shu Liu SmartMore
  • Jiaya Jia SmartMore Chinese University of Hong Kong




CV: Representation Learning for Vision, CV: Segmentation, ML: Representation Learning


Semantic segmentation is still a challenging task for parsing diverse contexts in different scenes, thus the fixed classifier might not be able to well address varying feature distributions during testing. Different from the mainstream literature where the efficacy of strong backbones and effective decoder heads has been well studied, in this paper, additional contextual hints are instead exploited via learning a context-aware classifier whose content is data-conditioned, decently adapting to different latent distributions. Since only the classifier is dynamically altered, our method is model-agnostic and can be easily applied to generic segmentation models. Notably, with only negligible additional parameters and +2\% inference time, decent performance gain has been achieved on both small and large models with challenging benchmarks, manifesting substantial practical merits brought by our simple yet effective method. The implementation is available at https://github.com/tianzhuotao/CAC.




How to Cite

Tian, Z., Cui, J., Jiang, L., Qi, X., Lai, X., Chen, Y., Liu, S., & Jia, J. (2023). Learning Context-Aware Classifier for Semantic Segmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 2438-2446. https://doi.org/10.1609/aaai.v37i2.25340



AAAI Technical Track on Computer Vision II