Tuning Parameter Selection for Underdetermined Reduced-Rank Regression

被引:6
|
作者
Ulfarsson, Magnus O. [1 ]
Solo, Victor [2 ]
机构
[1] Univ Iceland, Dept Elect & Comp Engn, IS-111 Reykjavik, Iceland
[2] Univ New S Wales, Sch Elect Engn, Sydney, NSW 2052, Australia
关键词
Model selection; reduced-rank regression; Stein's unbiased risk estimation (SURE); MODEL; REGULARIZATION; DIMENSION; SIGNALS; SURE;
D O I
10.1109/LSP.2013.2272463
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multivariate regression is one of the most widely applied multivariate statistical methods with many uses across a range of disciplines. But the number of parameters increases exponentially with dimension and reduced-rank regression (RRR) is a well known approach to dimension reduction. But traditional RRR applies only to an overdetermined system. For increasingly common undetermined systems this issue can be managed by regularization, e.g., with a quadratic penalty. A significant problem is then the choice of the two tuning parameters: one discrete i.e., the rank; the other continuous i.e., the Tikhonov penalty parameter. In this paper we resolve this problem via Stein's unbiased risk estimator (SURE). We compare SURE to cross-validation and apply it on both simulated and real data sets.
引用
收藏
页码:881 / 884
页数:4
相关论文
共 50 条
  • [1] Stability Approach to Regularization Selection for Reduced-Rank Regression
    Wen, Canhong
    Wang, Qin
    Jiang, Yuan
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2023, 32 (03) : 974 - 984
  • [2] Rank estimation in reduced-rank regression
    Bura, E
    Cook, RD
    JOURNAL OF MULTIVARIATE ANALYSIS, 2003, 87 (01) : 159 - 176
  • [3] PROCEDURES FOR REDUCED-RANK REGRESSION
    DAVIES, PT
    TSO, MKS
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 1982, 31 (03) : 244 - 255
  • [4] Reduced-rank linear regression
    Stoica, P
    Viberg, M
    8TH IEEE SIGNAL PROCESSING WORKSHOP ON STATISTICAL SIGNAL AND ARRAY PROCESSING, PROCEEDINGS, 1996, : 542 - 545
  • [5] BIPLOTS IN REDUCED-RANK REGRESSION
    TERBRAAK, CJF
    LOOMAN, CWN
    BIOMETRICAL JOURNAL, 1994, 36 (08) : 983 - 1003
  • [6] Envelopes and reduced-rank regression
    Cook, R. Dennis
    Forzani, Liliana
    Zhang, Xin
    BIOMETRIKA, 2015, 102 (02) : 439 - 456
  • [7] Robust reduced-rank regression
    She, Y.
    Chen, K.
    BIOMETRIKA, 2017, 104 (03) : 633 - 647
  • [8] Variable Selection with Nonconcave Penalty Function on Reduced-Rank Regression
    Jung, Sang Yong
    Park, Chongsun
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2015, 22 (01) : 41 - 54
  • [9] Sparse Reduced-Rank Regression for Simultaneous Dimension Reduction and Variable Selection
    Chen, Lisha
    Huang, Jianhua Z.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2012, 107 (500) : 1533 - 1545
  • [10] Sparse reduced-rank regression for simultaneous rank and variable selection via manifold optimization
    Kohei Yoshikawa
    Shuichi Kawano
    Computational Statistics, 2023, 38 : 53 - 75