Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

A Regularization Approach to Learning Task Relationships in Multitask Learning

A Regularization Approach to Learning Task Relationships in Multitask Learning A Regularization Approach to Learning Task Relationships in Multitask Learning YU ZHANG, Department of Computer Science, Hong Kong Baptist University DIT-YAN YEUNG, Department of Computer Science and Engineering, Hong Kong University of Science and Technology Multitask learning is a learning paradigm that seeks to improve the generalization performance of a learning task with the help of some other related tasks. In this article, we propose a regularization approach to learning the relationships between tasks in multitask learning. This approach can be viewed as a novel generalization of the regularized formulation for single-task learning. Besides modeling positive task correlation, our approach--multitask relationship learning (MTRL)--can also describe negative task correlation and identify outlier tasks based on the same underlying principle. By utilizing a matrix-variate normal distribution as a prior on the model parameters of all tasks, our MTRL method has a jointly convex objective function. For efficiency, we use an alternating method to learn the optimal model parameters for each task as well as the relationships between tasks. We study MTRL in the symmetric multitask learning setting and then generalize it to the asymmetric setting as well. We also discuss some variants of the regularization approach to demonstrate the use http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Knowledge Discovery from Data (TKDD) Association for Computing Machinery

A Regularization Approach to Learning Task Relationships in Multitask Learning

Loading next page...
 
/lp/association-for-computing-machinery/a-regularization-approach-to-learning-task-relationships-in-multitask-VxB90TjzwT

References (59)

Publisher
Association for Computing Machinery
Copyright
Copyright © 2014 by ACM Inc.
ISSN
1556-4681
DOI
10.1145/2538028
Publisher site
See Article on Publisher Site

Abstract

A Regularization Approach to Learning Task Relationships in Multitask Learning YU ZHANG, Department of Computer Science, Hong Kong Baptist University DIT-YAN YEUNG, Department of Computer Science and Engineering, Hong Kong University of Science and Technology Multitask learning is a learning paradigm that seeks to improve the generalization performance of a learning task with the help of some other related tasks. In this article, we propose a regularization approach to learning the relationships between tasks in multitask learning. This approach can be viewed as a novel generalization of the regularized formulation for single-task learning. Besides modeling positive task correlation, our approach--multitask relationship learning (MTRL)--can also describe negative task correlation and identify outlier tasks based on the same underlying principle. By utilizing a matrix-variate normal distribution as a prior on the model parameters of all tasks, our MTRL method has a jointly convex objective function. For efficiency, we use an alternating method to learn the optimal model parameters for each task as well as the relationships between tasks. We study MTRL in the symmetric multitask learning setting and then generalize it to the asymmetric setting as well. We also discuss some variants of the regularization approach to demonstrate the use

Journal

ACM Transactions on Knowledge Discovery from Data (TKDD)Association for Computing Machinery

Published: Jun 1, 2014

There are no references for this article.