Probability-Polarized Optimal Transport for Unsupervised Domain Adaptation

Authors

  • Yan Wang School of Mathematics, Sun Yat-Sen University, China
  • Chuan-Xian Ren School of Mathematics, Sun Yat-Sen University, China
  • Yi-Ming Zhai School of Mathematics, Sun Yat-Sen University, China
  • You-Wei Luo School of Mathematics, Sun Yat-Sen University, China
  • Hong Yan Department of Electrical Engineering, City University of Hong Kong, Hong Kong

DOI:

https://doi.org/10.1609/aaai.v38i14.29493

Keywords:

ML: Classification and Regression, ML: Transfer, Domain Adaptation, Multi-Task Learning

Abstract

Optimal transport (OT) is an important methodology to measure distribution discrepancy, which has achieved promising performance in artificial intelligence applications, e.g., unsupervised domain adaptation. However, from the view of transportation, there are still limitations: 1) the local discriminative structures for downstream tasks, e.g., cluster structure for classification, cannot be explicitly admitted by the learned OT plan; 2) the entropy regularization induces a dense OT plan with increasing uncertainty. To tackle these issues, we propose a novel Probability-Polarized OT (PPOT) framework, which can characterize the structure of OT plan explicitly. Specifically, the probability polarization mechanism is proposed to guide the optimization direction of OT plan, which generates a clear margin between similar and dissimilar transport pairs and reduces the uncertainty. Further, a dynamic mechanism for margin is developed by incorporating task-related information into the polarization, which directly captures the intra/inter class correspondence for knowledge transportation. A mathematical understanding for PPOT is provided from the view of gradient, which ensures interpretability. Extensive experiments on several datasets validate the effectiveness and empirical efficiency of PPOT.

Downloads

Published

2024-03-24

How to Cite

Wang, Y., Ren, C.-X., Zhai, Y.-M., Luo, Y.-W., & Yan, H. (2024). Probability-Polarized Optimal Transport for Unsupervised Domain Adaptation. Proceedings of the AAAI Conference on Artificial Intelligence, 38(14), 15653-15661. https://doi.org/10.1609/aaai.v38i14.29493

Issue

Section

AAAI Technical Track on Machine Learning V