Minimax estimation in multi-task regression under low-rank structures

被引:1
|
作者
Bak, Kwan-Young [1 ,2 ]
Koo, Ja-Yong [3 ]
机构
[1] Sungshin Womens Univ, Sch Math Stat & Data Sci, Seoul, South Korea
[2] Sungshin Womens Univ, Data Sci Ctr, Seoul, South Korea
[3] Korea Univ, Dept Stat, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Multi-task learning; information pooling; minimax theory; oracle inequality; reduced-rank estimation; DIMENSION;
D O I
10.1080/10485252.2022.2146110
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This study investigates the minimaxity of a multi-task nonparametric regression problem. We formulate a simultaneous function estimation problem based on information pooling across multiple experiments under a low-dimensional structure. A nonparametric reduced rank regression estimator based on the nuclear norm penalisation scheme is proposed to incorporate the low-dimensional structure in the estimation process. A rank of a set of functions is defined in terms of their Fourier coefficients to formally characterise the dependence structure among functions. Minimax upper and lower bounds are established under various asymptotic scenarios to examine the role of the low-rank structure in determining optimal rates of convergence. The results confirm that exploiting the low-rank structure can significantly improve the convergence rate for the simultaneous estimation of multiple functions. The results also imply that the proposed estimator is rate optimal in the minimax sense for the rank-constraint Sobolev class of vector-valued functions.
引用
收藏
页码:122 / 144
页数:23
相关论文
共 50 条
  • [21] Joint Sparse and Low-Rank Multi-Task Learning with Extended Multi-Attribute Profile for Hyperspectral Target Detection
    Wu, Xing
    Zhang, Xia
    Wang, Nan
    Cen, Yi
    REMOTE SENSING, 2019, 11 (02)
  • [22] TENSOR QUANTILE REGRESSION WITH LOW-RANK TENSOR TRAIN ESTIMATION
    Liu, Zihuan
    Lee, Cheuk Yin
    Zhang, Heping
    ANNALS OF APPLIED STATISTICS, 2024, 18 (02): : 1294 - 1318
  • [23] Multi-Task Nonparametric Regression Under Joint Sparsity
    Jhong, Jae-Hwan
    Kim, Gyeongmin
    Bak, Kwan-Young
    IEEE ACCESS, 2025, 13 : 25115 - 25126
  • [24] Low-rank feature selection for multi-view regression
    Rongyao Hu
    Debo Cheng
    Wei He
    Guoqiu Wen
    Yonghua Zhu
    Jilian Zhang
    Shichao Zhang
    Multimedia Tools and Applications, 2017, 76 : 17479 - 17495
  • [25] Low-rank feature selection for multi-view regression
    Hu, Rongyao
    Cheng, Debo
    He, Wei
    Wen, Guoqiu
    Zhu, Yonghua
    Zhang, Jilian
    Zhang, Shichao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (16) : 17479 - 17495
  • [26] Minimax perturbation bounds of the low-rank matrix under Ky Fan norm
    Qi, Xinyu
    Wang, Jinru
    Shao, Jiating
    AIMS MATHEMATICS, 2022, 7 (05): : 7595 - 7605
  • [27] On Low-rank Trace Regression under General Sampling Distribution
    Hamdi, Nima
    Bayati, Mohsen
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [28] SPARSE AND LOW-RANK MATRIX QUANTILE ESTIMATION WITH APPLICATION TO QUADRATIC REGRESSION
    Lu, Wenqi
    Zhu, Zhongyi
    Lian, Heng
    STATISTICA SINICA, 2023, 33 (02) : 945 - 959
  • [29] Leverage triple relational structures via low-rank feature reduction for multi-output regression
    Shichao Zhang
    Lifeng Yang
    Zhenyun Deng
    Debo Cheng
    Yonggang Li
    Multimedia Tools and Applications, 2017, 76 : 17461 - 17477
  • [30] Leverage triple relational structures via low-rank feature reduction for multi-output regression
    Zhang, Shichao
    Yang, Lifeng
    Deng, Zhenyun
    Cheng, Debo
    Li, Yonggang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (16) : 17461 - 17477