Multi-Task Nonparametric Regression Under Joint Sparsity

被引:0
|
作者
Jhong, Jae-Hwan [1 ]
Kim, Gyeongmin [2 ]
Bak, Kwan-Young [2 ,3 ]
机构
[1] Chungbuk Natl Univ, Dept Informat Stat, Cheongju 28644, South Korea
[2] Sungshin Womens Univ, Sch Math Stat & Data Sci, Seoul 02844, South Korea
[3] Sungshin Womens Univ, Data Sci Ctr, Seoul 02844, South Korea
来源
IEEE ACCESS | 2025年 / 13卷
基金
新加坡国家研究基金会;
关键词
Group sparsity; information pooling; multi-task learning; oracle inequality; DIMENSION;
D O I
10.1109/ACCESS.2025.3538481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study investigates a multi-task estimation under joint sparsity. We consider estimating multiple functions when functions of interest share common sparsity patterns. An l(2 ) penalty is imposed to enforce common sparsity patterns across component functions. A non-asymptotic oracle inequality is established to illustrate a possible improvement of the estimation error bound achieved by the proposed pooled estimator in comparison with the usual projection estimator. The proposed method is implemented with the alternating direction method of multipliers algorithm. Numerical studies are conducted to complement the theoretical results. We apply the proposed method to the ozone data to illustrate a practical applicability. The numerical results show that the proposed method detects the underlying sparsity patterns, thereby providing a desirable estimator that significantly outperforms the projection estimator.
引用
收藏
页码:25115 / 25126
页数:12
相关论文
共 50 条
  • [1] Nonparametric multi-task regression under group sparsity and low-rank structures
    Nam, Donghwi
    Koo, Ja-Yong
    Bak, Kwan-Young
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2025,
  • [2] Multi-task Sparse Gaussian Processes with Improved Multi-task Sparsity Regularization
    Zhu, Jiang
    Sun, Shiliang
    PATTERN RECOGNITION (CCPR 2014), PT I, 2014, 483 : 54 - 62
  • [3] Multi-task Function-on-function Regression with Co-grouping Structured Sparsity
    Yang, Pei
    Tan, Qi
    He, Jingrui
    KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 1255 - 1264
  • [4] Multi-task neural networks for joint hippocampus segmentation and clinical score regression
    Liang Cao
    Long Li
    Jifeng Zheng
    Xin Fan
    Feng Yin
    Hui Shen
    Jun Zhang
    Multimedia Tools and Applications, 2018, 77 : 29669 - 29686
  • [5] Multi-task neural networks for joint hippocampus segmentation and clinical score regression
    Cao, Liang
    Li, Long
    Zheng, Jifeng
    Fan, Xin
    Yin, Feng
    Shen, Hui
    Zhang, Jun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (22) : 29669 - 29686
  • [6] Multi-task ordinal regression with task weight discovery
    Xiao, Yanshan
    Zeng, Mengyue
    Liu, Bo
    Zhao, Liang
    Kong, Xiangjun
    Hao, Zhifeng
    KNOWLEDGE-BASED SYSTEMS, 2024, 305
  • [7] NONPARAMETRIC BAYESIAN FEATURE SELECTION FOR MULTI-TASK LEARNING
    Li, Hui
    Liao, Xuejun
    Carin, Lawrence
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 2236 - 2239
  • [8] TOMATO: A Topic-Wise Multi-Task Sparsity Model
    Zhang, Jason
    Lee, Dongwon
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 1793 - 1802
  • [9] Encoding Tree Sparsity in Multi-Task Learning: A Probabilistic Framework
    Han, Lei
    Zhang, Yu
    Song, Guojie
    Xie, Kunqing
    PROCEEDINGS OF THE TWENTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2014, : 1854 - 1860
  • [10] Joint Classification and Trajectory Regression of Online Handwriting using a Multi-Task Learning Approach
    Ott, Felix
    Ruegamer, David
    Heublein, Lucas
    Bischl, Bernd
    Mutschler, Christopher
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1244 - 1254