Tuning Parameter Selection for Underdetermined Reduced-Rank Regression

被引:6
|
作者
Ulfarsson, Magnus O. [1 ]
Solo, Victor [2 ]
机构
[1] Univ Iceland, Dept Elect & Comp Engn, IS-111 Reykjavik, Iceland
[2] Univ New S Wales, Sch Elect Engn, Sydney, NSW 2052, Australia
关键词
Model selection; reduced-rank regression; Stein's unbiased risk estimation (SURE); MODEL; REGULARIZATION; DIMENSION; SIGNALS; SURE;
D O I
10.1109/LSP.2013.2272463
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multivariate regression is one of the most widely applied multivariate statistical methods with many uses across a range of disciplines. But the number of parameters increases exponentially with dimension and reduced-rank regression (RRR) is a well known approach to dimension reduction. But traditional RRR applies only to an overdetermined system. For increasingly common undetermined systems this issue can be managed by regularization, e.g., with a quadratic penalty. A significant problem is then the choice of the two tuning parameters: one discrete i.e., the rank; the other continuous i.e., the Tikhonov penalty parameter. In this paper we resolve this problem via Stein's unbiased risk estimator (SURE). We compare SURE to cross-validation and apply it on both simulated and real data sets.
引用
收藏
页码:881 / 884
页数:4
相关论文
共 50 条
  • [21] Reduced-rank regression: A useful determinant identity
    Hansen, Peter Reinhard
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2008, 138 (09) : 2688 - 2697
  • [22] REDUCED-RANK REGRESSION AND CANONICAL-ANALYSIS
    TSO, MKS
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1981, 43 (02): : 183 - 189
  • [23] Sparse reduced-rank regression with covariance estimation
    Chen, Lisha
    Huang, Jianhua Z.
    STATISTICS AND COMPUTING, 2016, 26 (1-2) : 461 - 470
  • [24] Adaptive reduced-rank interference suppression with adaptive rank selection
    Honig, ML
    Xiao, WM
    MILCOM 2000: 21ST CENTURY MILITARY COMMUNICATIONS CONFERENCE PROCEEDINGS, VOLS 1 AND 2: ARCHITECTURES & TECHNOLOGIES FOR INFORMATION SUPERIORITY, 2000, : 747 - 751
  • [25] Efficient Sparse Reduced-Rank Regression With Covariance Estimation
    Li, Fengpei
    Zhao, Ziping
    2023 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP, SSP, 2023, : 46 - 50
  • [26] Robust Sparse Reduced-Rank Regression with Response Dependency
    Liu, Wenchen
    Liu, Guanfu
    Tang, Yincai
    SYMMETRY-BASEL, 2022, 14 (08):
  • [27] Psychological disorders and dietary patterns by reduced-rank regression
    Mahdieh Hosseinzadeh
    Mohammad-Reza Vafa
    Ahmad Esmaillzadeh
    Awat Feizi
    Reza Majdzadeh
    Hamidreza Afshar
    Ammar Hassanzadeh Keshteli
    Peyman Adibi
    European Journal of Clinical Nutrition, 2019, 73 : 408 - 415
  • [28] Parametric and semiparametric reduced-rank regression with flexible sparsity
    Lian, Heng
    Feng, Sanying
    Zhao, Kaifeng
    JOURNAL OF MULTIVARIATE ANALYSIS, 2015, 136 : 163 - 174
  • [29] Psychological disorders and dietary patterns by reduced-rank regression
    Hosseinzadeh, Mandieh
    Vafa, Mohammad-Reza
    Esmaillzadeh, Ahmad
    Feizi, Awat
    Majdzadeh, Reza
    Afshar, Hamidreza
    Keshtel, Ammar Hassanzadeh
    Adibi, Peyman
    EUROPEAN JOURNAL OF CLINICAL NUTRITION, 2019, 73 (03) : 408 - 415
  • [30] On multivariate linear regression shrinkage and reduced-rank procedures
    Reinsel, GC
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 1999, 81 (02) : 311 - 321