SCAN: Cross Domain Object Detection with Semantic Conditioned Adaptation
DOI:
https://doi.org/10.1609/aaai.v36i2.20031Keywords:
Computer Vision (CV), Knowledge Representation And Reasoning (KRR)Abstract
The domain gap severely limits the transferability and scalability of object detectors trained in a specific domain when applied to a novel one. Most existing works bridge the domain gap by minimizing the domain discrepancy in the category space and aligning category-agnostic global features. Though great success, these methods model domain discrepancy with prototypes within a batch, yielding a biased estimation of domain-level distribution. Besides, the category-agnostic alignment leads to the disagreement of class-specific distributions in the two domains, further causing inevitable classification errors. To overcome these two challenges, we propose a novel Semantic Conditioned AdaptatioN (SCAN) framework such that well-modeled unbiased semantics can support semantic conditioned adaptation for precise domain adaptive object detection. Specifically, class-specific semantics crossing different images in the source domain are graphically aggregated as the input to learn an unbiased semantic paradigm incrementally. The paradigm is then sent to a lightweight manifestation module to obtain conditional kernels to serve as the role of extracting semantics from the target domain for better adaptation. Subsequently, conditional kernels are integrated into global alignment to support the class-specific adaptation in a well-designed Conditional Kernel guided Alignment (CKA) module. Meanwhile, rich knowledge of the unbiased paradigm is transferred to the target domain with a novel Graph-based Semantic Transfer (GST) mechanism, yielding the adaptation in the category-based feature space. Comprehensive experiments conducted on three adaptation benchmarks demonstrate that SCAN outperforms existing works by a large margin.Downloads
Published
2022-06-28
How to Cite
Li, W., Liu, X., Yao, X., & Yuan, Y. (2022). SCAN: Cross Domain Object Detection with Semantic Conditioned Adaptation. Proceedings of the AAAI Conference on Artificial Intelligence, 36(2), 1421-1428. https://doi.org/10.1609/aaai.v36i2.20031
Issue
Section
AAAI Technical Track on Computer Vision II