Access the full text.
Sign up today, get DeepDyve free for 14 days.
Hoai Thi, D. Phan (2016)
DC programming and DCA for sparse optimal scoring problemNeurocomputing, 186
Hoai Thi, Ngai Huynh, T. Dinh (2014)
DC Programming and DCA for General DC Programs
D. Phan, Hoai Thi (2019)
Group variable selection via ℓp, 0 regularization and application to optimal scoringNeural networks : the official journal of the International Neural Network Society, 118
Cheng-Few Lee, Alice Lee, John Lee (2010)
Handbook of Quantitative Finance and Risk Management
Eleftherios Xioufis, Grigorios Tsoumakas, William Groves, I. Vlahavas (2012)
Multi-target regression via input space expansion: treating targets as inputsMachine Learning, 104
Hoai Thi, T. Dinh (2017)
Difference of convex functions algorithms (DCA) for image restoration via a Markov random field modelOptimization and Engineering, 18
T. Dinh, Hoai Thi (2013)
Recent Advances in DC Programming and DCATrans. Comput. Collect. Intell., 13
M. Yuan, Ali Ekici, Zhaosong Lu, R. Monteiro (2007)
Dimension reduction and coefficient estimation in multivariate linear regressionJournal of the Royal Statistical Society: Series B (Statistical Methodology), 69
J. Magnus, H. Neudecker (1985)
Matrix differential calculus with applications to simple, Hadamard, and Kronecker products.Journal of Optimization Theory and Applications
Dan He, D. Kuhn, L. Parida (2016)
Novel applications of multitask learning and multiple output regression to multiple genetic trait predictionBioinformatics, 32
(1997)
Constraint-handling techniques - penalty functions
G. Salinetti, R. Wets (1977)
On the relations between two types of convergence for convex functionsJournal of Mathematical Analysis and Applications, 60
Hoai Thi, T. Dinh (2005)
The DC (Difference of Convex Functions) Programming and DCA Revisited with DC Models of Real World Nonconvex Optimization ProblemsAnnals of Operations Research, 133
A. Izenman (1975)
Reduced-rank regression for the multivariate linear modelJournal of Multivariate Analysis, 5
L. Harrison, W. Penny, Karl Friston (2003)
Multivariate Autoregressive Modelling of fMRI time series
Hoai Thi, Vinh Ho (2020)
Online Learning Based on Online DCA and Application to Online ClassificationNeural Computation, 32
Hoai Thi (2020)
DC programming and DCA for supply chain and production management: state-of-the-art models and methodsInternational Journal of Production Research, 58
G. Reinsel, R. Velu (1998)
Multivariate Reduced-Rank Regression: Theory and Applications
Wooseok Ha, R. Barber (2017)
Alternating minimization and alternating descent over nonconvex setsarXiv: Optimization and Control
Hoai Thi, M. Moeini, T. Dinh (2009)
Portfolio selection under downside risk measures and cardinality constraints based on DC programming and DCAComputational Management Science, 6
Benjamin Dubois, Jean-François Delmas, G. Obozinski (2019)
Fast Algorithms for Sparse Reduced-Rank Regression
Hoai Thi, L. Minh, Phan Nhat, Bach Tran (2017)
Stochastic DCA for the Large-sum of Non-convex Functions Problem and its Application to Group Variable Selection in Classification
Zhanxuan Hu, F. Nie, Lai Tian, Rong Wang, Xuelong Li (2018)
Low Rank Regularization: A reviewNeural networks : the official journal of the International Neural Network Society
Hoai Thi, T. Dinh (2018)
DC programming and DCA: thirty years of developmentsMath. Program., 169
C. Zălinescu (2002)
Convex analysis in general vector spaces
T. Dinh, Hoai Thi (1997)
Convex analysis approach to d.c. programming: Theory, Algorithm and Applications, 22
Hoai Thi, M. Nguyen (2017)
DCA based algorithms for feature selection in multi-class support vector machineAnnals of Operations Research, 249
HA Le Thi, T Pham Dinh (2018)
DC Programming and DCA: thirty years of developments. Mathematical programming, Special issue: DC Programming - TheoryAlgorithms and Applications, 169
Hoai Thi, M. Nguyen, T. Dinh (2014)
A DC Programming Approach for Finding Communities in NetworksNeural Computation, 26
W. Gander, U. Matt (1998)
A D.C. OPTIMIZATION ALGORITHM FOR SOLVING THE TRUST-REGION SUBPROBLEM∗
Hoai Thi (2003)
Solving Large Scale Molecular Distance Geometry Problems by a Smoothing Technique via the Gaussian Transform and D.C. ProgrammingJ. Glob. Optim., 27
S. Wold, M. Sjöström, L. Eriksson (2001)
PLS-regression: a basic tool of chemometricsChemometrics and Intelligent Laboratory Systems, 58
T. Cover, Joy Thomas (1988)
Determinant inequalities via information theorySIAM Journal on Matrix Analysis and Applications, 9
Lisha Chen, Jianhua Huang (2012)
Sparse Reduced-Rank Regression for Simultaneous Dimension Reduction and Variable SelectionJournal of the American Statistical Association, 107
Tran Thuy, Hoai Thi, T. Dinh (2017)
DC programming and DCA for enhancing physical layer security via cooperative jammingComput. Oper. Res., 87
Rina Foygel, M. Horrell, M. Drton, J. Lafferty (2012)
Nonparametric Reduced Rank Regression
J. Jackson (2005)
Reduced Rank Regression
L. Hoai, H. Ngai, P. Tao (2016)
Alternative DC Algorithm for Partial DC programming
Hoai Thi, T. Dinh, Ngai Huynh (2012)
Exact penalty and error bounds in DC programmingJournal of Global Optimization, 52
L. Minh, Hoai Thi, M. Nguyen (2015)
Sparse semi-supervised support vector machines by DC programming and DCANeurocomputing, 153
Nguyen Nam, Hoai Thi, Daniel Giles, Nguyen An (2020)
Smoothing techniques and difference of convex functions algorithms for image reconstructionsOptimization, 69
L. Thi, H. An (1994)
Analyse numérique des algorithmes de l'optimisation D. C. . Approches locale et globale. Codes et simulations numériques en grande dimension. Applications
Hoai Thi, Vinh Ho, T. Dinh (2018)
A unified DC programming framework and efficient DCA based approaches for large scale batch reinforcement learningJournal of Global Optimization, 73
C. Eckart, G. Young (1936)
The approximation of one matrix by another of lower rankPsychometrika, 1
Harveer Dev, N. Sharma, Sarah Dawson, David Neal, N. Shah (2012)
Detailed analysis of operating time learning curves in robotic prostatectomy by a novice surgeonBJU International, 109
Hoai Thi, T. Dinh, L. Minh, X. Vo (2014)
DC approximation approaches for sparse optimizationEur. J. Oper. Res., 244
(2014)
New and efficient DCA based algorithms for minimum sum-ofsquares clustering
A. Ioffe, V. Tikhomirov (1979)
Theory of extremal problems
E. Hyams, J. Mullins, P. Pierorazio, A. Partin, M. Allaf, B. Matlaga (2013)
Impact of robotic technique and surgical volume on the cost of radical prostatectomy.Journal of endourology, 27 3
Lisha Chen, Jianhua Huang (2016)
Sparse reduced-rank regression with covariance estimationStatistics and Computing, 26
Hoai Thi, Ta Son, T. Dinh (2018)
An efficient DCA based algorithm for power control in large scale wireless networksAppl. Math. Comput., 318
S. Koshi (1985)
Convergence of convex functions and dualityHokkaido Mathematical Journal, 14
Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations
We study a challenging problem in machine learning that is the reduced-rank multitask linear regression with covariance matrix estimation. The objective is to build a linear relationship between multiple output variables and input variables of a multitask learning process, taking into account the general covariance structure for the errors of the regression model in one hand, and reduced-rank regression model in another hand. The problem is formulated as minimizing a nonconvex function in two joint matrix variables (X,Θ) under the low-rank constraint on X and positive definiteness constraint on Θ. It has a double difficulty due to the non-convexity of the objective function as well as the low-rank constraint. We investigate a nonconvex, nonsmooth optimization approach based on DC (Difference of Convex functions) programming and DCA (DC Algorithm) for this hard problem. A penalty reformulation is considered which takes the form of a partial DC program. An alternating DCA and its inexact version are developed, both algorithms converge to a weak critical point of the considered problem. Numerical experiments are performed on several synthetic and benchmark real multitask linear regression datasets. The numerical results show the performance of the proposed algorithms and their superiority compared with three classical alternating/joint methods.
Annals of Mathematics and Artificial Intelligence – Springer Journals
Published: Sep 1, 2022
Keywords: Reduced-rank multitask linear regression; Covariance matrix estimation; DC programming; DCA; Partial DC program; Alternating DCA; 90C26; 90C90; 62J05
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.