Learning Sparse Task Relations in Multi-Task Learning

Authors

  • Yu Zhang Hong Kong University of Science and Technology
  • Qiang Yang Hong Kong University of Science and Technology

DOI:

https://doi.org/10.1609/aaai.v31i1.10820

Keywords:

Multi-Task Learning

Abstract

In multi-task learning, when the number of tasks is large, pairwise task relations exhibit sparse patterns since usually a task cannot be helpful to all of the other tasks and moreover, sparse task relations can reduce the risk of overfitting compared with the dense ones. In this paper, we focus on learning sparse task relations. Based on a regularization framework which can learn task relations among multiple tasks, we propose a SParse covAriance based mulTi-taSk (SPATS) model to learn a sparse covariance by using the ℓl regularization. The resulting objective function of the SPATS method is convex, which allows us to devise an alternating method to solve it. Moreover, some theoretical properties of the proposed model are studied. Experiments on synthetic and real-world datasets demonstrate the effectiveness of the proposed method.

Downloads

Published

2017-02-13

How to Cite

Zhang, Y., & Yang, Q. (2017). Learning Sparse Task Relations in Multi-Task Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 31(1). https://doi.org/10.1609/aaai.v31i1.10820