CL3D: Unsupervised Domain Adaptation for Cross-LiDAR 3D Detection

Authors

  • Xidong Peng ShanghaiTech University
  • Xinge Zhu The Chinese University of Hong Kong
  • Yuexin Ma ShanghaiTech University Shanghai Engineering Research Center of Intelligent Vision and Imaging

DOI:

https://doi.org/10.1609/aaai.v37i2.25297

Keywords:

CV: 3D Computer Vision, CV: Object Detection & Categorization, CV: Vision for Robotics & Autonomous Driving, ML: Transfer, Domain Adaptation, Multi-Task Learning

Abstract

Domain adaptation for Cross-LiDAR 3D detection is challenging due to the large gap on the raw data representation with disparate point densities and point arrangements. By exploring domain-invariant 3D geometric characteristics and motion patterns, we present an unsupervised domain adaptation method that overcomes above difficulties. First, we propose the Spatial Geometry Alignment module to extract similar 3D shape geometric features of the same object class to align two domains, while eliminating the effect of distinct point distributions. Second, we present Temporal Motion Alignment module to utilize motion features in sequential frames of data to match two domains. Prototypes generated from two modules are incorporated into the pseudo-label reweighting procedure and contribute to our effective self-training framework for the target domain. Extensive experiments show that our method achieves state-of-the-art performance on cross-device datasets, especially for the datasets with large gaps captured by mechanical scanning LiDARs and solid-state LiDARs in various scenes. Project homepage is at https://github.com/4DVLab/CL3D.git.

Downloads

Published

2023-06-26

How to Cite

Peng, X., Zhu, X., & Ma, Y. (2023). CL3D: Unsupervised Domain Adaptation for Cross-LiDAR 3D Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 2047-2055. https://doi.org/10.1609/aaai.v37i2.25297

Issue

Section

AAAI Technical Track on Computer Vision II