Minimax estimation in multi-task regression under low-rank structures

被引:1
|
作者
Bak, Kwan-Young [1 ,2 ]
Koo, Ja-Yong [3 ]
机构
[1] Sungshin Womens Univ, Sch Math Stat & Data Sci, Seoul, South Korea
[2] Sungshin Womens Univ, Data Sci Ctr, Seoul, South Korea
[3] Korea Univ, Dept Stat, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Multi-task learning; information pooling; minimax theory; oracle inequality; reduced-rank estimation; DIMENSION;
D O I
10.1080/10485252.2022.2146110
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This study investigates the minimaxity of a multi-task nonparametric regression problem. We formulate a simultaneous function estimation problem based on information pooling across multiple experiments under a low-dimensional structure. A nonparametric reduced rank regression estimator based on the nuclear norm penalisation scheme is proposed to incorporate the low-dimensional structure in the estimation process. A rank of a set of functions is defined in terms of their Fourier coefficients to formally characterise the dependence structure among functions. Minimax upper and lower bounds are established under various asymptotic scenarios to examine the role of the low-rank structure in determining optimal rates of convergence. The results confirm that exploiting the low-rank structure can significantly improve the convergence rate for the simultaneous estimation of multiple functions. The results also imply that the proposed estimator is rate optimal in the minimax sense for the rank-constraint Sobolev class of vector-valued functions.
引用
收藏
页码:122 / 144
页数:23
相关论文
共 50 条
  • [11] MULTI-TASK LEARNING WITH LOW-RANK MATRIX FACTORIZATION FOR HYPERSPECTRAL NONLINEAR UNMIXING
    Su, Yuanchao
    Li, Jun
    Qi, Hairong
    Gamba, Paolo
    Plaza, Antonio
    Plaza, Javier
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2127 - 2130
  • [12] MULTI-LINGUAL SPEECH RECOGNITION WITH LOW-RANK MULTI-TASK DEEP NEURAL NETWORKS
    Mohan, Aanchan
    Rose, Richard
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 4994 - 4998
  • [13] Multi-task Sparse Low-Rank Learning for Multi-classification of Parkinson's Disease
    Lei, Haijun
    Zhao, Yujia
    Lei, Baiying
    DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 : 361 - 368
  • [14] Multi-task Joint Sparse and Low-rank Representation Target Detection for Hyperspectral Image
    Wu, Xing
    Zhang, Xia
    Cen, Yi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (11) : 1756 - 1760
  • [15] Minimax estimation of low-rank quantum states and their linear functionals
    Lahiry, Samriddha
    Nussbaum, Michael
    BERNOULLI, 2024, 30 (01) : 610 - 635
  • [16] Multi-Task Rank Learning for Visual Saliency Estimation
    Li, Jia
    Tian, Yonghong
    Huang, Tiejun
    Gao, Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2011, 21 (05) : 623 - 636
  • [17] Low-rank tensor fusion and self-supervised multi-task multimodal sentiment analysis
    Miao, Xinmeng
    Zhang, Xuguang
    Zhang, Haoran
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (23) : 63291 - 63308
  • [18] Predicting Early Stages of Neurodegenerative Diseases via Multi-task Low-Rank Feature Learning
    Lei, Haijun
    Zhao, Yujia
    Lei, Baiying
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV, 2019, 11767 : 131 - 139
  • [19] Rank-Based Multi-task Learning For Fair Regression
    Zhao, Chen
    Chen, Feng
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 916 - 925
  • [20] Structured and weighted multi-task low rank tracker
    Fan, Baojie
    Li, Xiaomao
    Cong, Yang
    Tang, Yandong
    PATTERN RECOGNITION, 2018, 81 : 528 - 544