Error-Aware Density Isomorphism Reconstruction for Unsupervised Cross-Domain Crowd Counting

Authors

  • Yuhang He Xi’an Jiaotong University
  • Zhiheng Ma Xi'an Jiaotong University
  • Xing Wei Xi'an Jiaotong University
  • Xiaopeng Hong Xi'an Jiaotong University Peng Cheng Laboratory
  • Wei Ke Xi'an Jiaotong University
  • Yihong Gong Xi'an Jiaotong University

DOI:

https://doi.org/10.1609/aaai.v35i2.16245

Keywords:

Applications

Abstract

This paper focuses on the unsupervised domain adaptation problem for video-based crowd counting, in which we use labeled data as source domain and unlabelled video data as target domain. It is challenging as there is a huge gap between the source and the target domain and no annotations of samples are available in the target domain. The key issue is how to utilize unlabelled videos in the target domain for knowledge learning and transferring from the source domain. To tackle this problem, we propose a novel Error-aware Density Isomorphism REConstruction Network (EDIREC-Net) for cross-domain crowd counting. EDIREC-Net jointly transfers a pre-trained counting model to target domains using a density isomorphism reconstruction objective and models the reconstruction erroneousness by error reasoning. Specifically, as crowd flows in videos are consecutive, the density maps in adjacent frames turn out to be isomorphic. On this basis, we regard the density isomorphism reconstruction error as a self-supervised signal to transfer the pre-trained counting models to different target domains. Moreover, we leverage an estimation-reconstruction consistency to monitor the density reconstruction erroneousness and suppress unreliable density reconstructions during training. Experimental results on four benchmark datasets demonstrate the superiority of the proposed method and ablation studies investigate the efficiency and robustness. The source code is available at https://github.com/GehenHe/EDIREC-Net.

Downloads

Published

2021-05-18

How to Cite

He, Y., Ma, Z., Wei, X., Hong, X., Ke, W., & Gong, Y. (2021). Error-Aware Density Isomorphism Reconstruction for Unsupervised Cross-Domain Crowd Counting. Proceedings of the AAAI Conference on Artificial Intelligence, 35(2), 1540-1548. https://doi.org/10.1609/aaai.v35i2.16245

Issue

Section

AAAI Technical Track on Computer Vision I