Minimax estimation in multi-task regression under low-rank structures

被引:1
|
作者
Bak, Kwan-Young [1 ,2 ]
Koo, Ja-Yong [3 ]
机构
[1] Sungshin Womens Univ, Sch Math Stat & Data Sci, Seoul, South Korea
[2] Sungshin Womens Univ, Data Sci Ctr, Seoul, South Korea
[3] Korea Univ, Dept Stat, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Multi-task learning; information pooling; minimax theory; oracle inequality; reduced-rank estimation; DIMENSION;
D O I
10.1080/10485252.2022.2146110
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This study investigates the minimaxity of a multi-task nonparametric regression problem. We formulate a simultaneous function estimation problem based on information pooling across multiple experiments under a low-dimensional structure. A nonparametric reduced rank regression estimator based on the nuclear norm penalisation scheme is proposed to incorporate the low-dimensional structure in the estimation process. A rank of a set of functions is defined in terms of their Fourier coefficients to formally characterise the dependence structure among functions. Minimax upper and lower bounds are established under various asymptotic scenarios to examine the role of the low-rank structure in determining optimal rates of convergence. The results confirm that exploiting the low-rank structure can significantly improve the convergence rate for the simultaneous estimation of multiple functions. The results also imply that the proposed estimator is rate optimal in the minimax sense for the rank-constraint Sobolev class of vector-valued functions.
引用
收藏
页码:122 / 144
页数:23
相关论文
共 50 条
  • [1] Nonparametric multi-task regression under group sparsity and low-rank structures
    Nam, Donghwi
    Koo, Ja-Yong
    Bak, Kwan-Young
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2025,
  • [2] Robust Multi-Task Regression with Shifting Low-Rank Patterns
    Junfeng Cui
    Guanghui Wang
    Fengyi Song
    Xiaoyan Ma
    Changliang Zou
    Acta Mathematica Sinica,English Series, 2025, (02) : 677 - 702
  • [3] Robust Multi-Task Regression with Shifting Low-Rank Patterns
    Cui, Junfeng
    Wang, Guanghui
    Song, Fengyi
    Ma, Xiaoyan
    Zou, Changliang
    ACTA MATHEMATICA SINICA-ENGLISH SERIES, 2025, 41 (02) : 677 - 702
  • [4] Multi-task Low-rank Affinity Pursuit for Image Segmentation
    Cheng, Bin
    Liu, Guangcan
    Wang, Jingdong
    Huang, Zhongyang
    Yan, Shuicheng
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 2439 - 2446
  • [5] Learning Linear and Nonlinear Low-Rank Structure in Multi-Task Learning
    Zhang, Yi
    Zhang, Yu
    Wang, Wei
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (08) : 8157 - 8170
  • [6] MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning
    Agiza, Ahmed
    Neseem, Marina
    Reda, Sherief
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 16196 - 16205
  • [7] Multi-Task Low-Rank Metric Learning Based on Common Subspace
    Yang, Peipei
    Huang, Kaizhu
    Liu, Cheng-Lin
    NEURAL INFORMATION PROCESSING, PT II, 2011, 7063 : 151 - 159
  • [8] MULTI-TASK LEARNING VIA SHARING INEXACT LOW-RANK SUBSPACE
    Wang, Xiaoqian
    Nie, Feiping
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3690 - 3694
  • [9] Low-Rank Updates of pre-trainedWeights for Multi-Task Learning
    Audibert, Alexandre
    Amini, Massih-Reza
    Usevich, Konstantin
    Clausel, Marianne
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 7544 - 7554
  • [10] MULTI-TASK LOW-RANK AND SPARSE MATRIX RECOVERY FOR HUMAN MOTION SEGMENTATION
    Wang, Xiangyang
    Wan, Wanggen
    Liu, Guangcan
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 897 - 900