Distant Transfer Learning via Deep Random Walk

Authors

  • Qiao Xiao Department of Computer Science and Engineering, Southern University of Science and Technology
  • Yu Zhang Department of Computer Science and Engineering, Southern University of Science and Technology Peng Cheng Laboratory

Keywords:

Transfer/Adaptation/Multi-task/Meta/Automated Learning

Abstract

Transfer learning, which is to improve the learning performance in the target domain by leveraging useful knowledge from the source domain, often requires that those two domains are very close, which limits its application scope. Recently, distant transfer learning has been studied to transfer knowledge between two distant or even totally unrelated domains via unlabeled auxiliary domains that act as a bridge in the spirit of human transitive inference that two completely unrelated concepts can be connected through gradual knowledge transfer. In this paper, we study distant transfer learning by proposing a DeEp Random Walk basEd distaNt Transfer (DERWENT) method. Different from existing distant transfer learning models that implicitly identify the path of knowledge transfer between the source and target instances through auxiliary instances, the proposed DERWENT model can explicitly learn such paths via the deep random walk technique. Specifically, based on sequences identified by the random walk technique on a data graph where source and target data have no direct connection, the proposed DERWENT model enforces adjacent data points in a sequence to be similar, makes the ending data point be represented by other data points in the same sequence, and considers weighted classification losses of source data. Empirical studies on several benchmark datasets demonstrate that the proposed DERWENT algorithm yields the state-of-the-art performance.

Downloads

Published

2021-05-18

How to Cite

Xiao, Q., & Zhang, Y. (2021). Distant Transfer Learning via Deep Random Walk. Proceedings of the AAAI Conference on Artificial Intelligence, 35(12), 10422-10429. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/17248

Issue

Section

AAAI Technical Track on Machine Learning V