Consistent Bayesian information criterion based on a mixture prior for possibly high-dimensional multivariate linear regression models

被引:2
|
作者
Kono, Haruki [1 ]
Kubokawa, Tatsuya [2 ]
机构
[1] MIT, Dept Econ, Cambridge, MA 02139 USA
[2] Univ Tokyo, Dept Econ, Tokyo, Japan
基金
日本学术振兴会;
关键词
consistency; high-dimensional data; information criterion; mixture distribution; multivariate linear regression; variable selection; SELECTION; WISHART;
D O I
10.1111/sjos.12617
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In the problem of selecting variables in a multivariate linear regression model, we derive new Bayesian information criteria based on a prior mixing a smooth distribution and a delta distribution. Each of them can be interpreted as a fusion of the Akaike information criterion (AIC) and the Bayesian information criterion (BIC). Inheriting their asymptotic properties, our information criteria are consistent in variable selection in both the large-sample and the high-dimensional asymptotic frameworks. In numerical simulations, variable selection methods based on our information criteria choose the true set of variables with high probability in most cases.
引用
收藏
页码:1022 / 1047
页数:26
相关论文
共 50 条
  • [41] Shrinkage Ridge Regression Estimators in High-Dimensional Linear Models
    Yuzbasi, Bahadir
    Ahmed, S. Ejaz
    PROCEEDINGS OF THE NINTH INTERNATIONAL CONFERENCE ON MANAGEMENT SCIENCE AND ENGINEERING MANAGEMENT, 2015, 362 : 793 - 807
  • [42] Clustering electricity consumers using high-dimensional regression mixture models
    Devijver, Emilie
    Goude, Yannig
    Poggi, Jean-Michel
    APPLIED STOCHASTIC MODELS IN BUSINESS AND INDUSTRY, 2020, 36 (01) : 159 - 177
  • [43] Extended Bayesian information criterion in the Cox model with a high-dimensional feature space
    Shan Luo
    Jinfeng Xu
    Zehua Chen
    Annals of the Institute of Statistical Mathematics, 2015, 67 : 287 - 311
  • [44] Extended Bayesian information criterion in the Cox model with a high-dimensional feature space
    Luo, Shan
    Xu, Jinfeng
    Chen, Zehua
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2015, 67 (02) : 287 - 311
  • [45] Bayesian regression based on principal components for high-dimensional data
    Lee, Jaeyong
    Oh, Hee-Seok
    JOURNAL OF MULTIVARIATE ANALYSIS, 2013, 117 : 175 - 192
  • [46] Robust and consistent variable selection in high-dimensional generalized linear models
    Avella-Medina, Marco
    Ronchetti, Elvezio
    BIOMETRIKA, 2018, 105 (01) : 31 - 44
  • [47] Multivariate linear regression of high-dimensional fMRI data with multiple target variables
    Valente, Giancarlo
    Castellanos, Agustin Lage
    Vanacore, Gianluca
    Formisano, Elia
    HUMAN BRAIN MAPPING, 2014, 35 (05) : 2163 - 2177
  • [48] Scalable High-Dimensional Multivariate Linear Regression for Feature-Distributed Data
    Huang, Shuo-Chieh
    Tsay, Ruey S.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25
  • [49] RELATIVE COST BASED MODEL SELECTION FOR SPARSE HIGH-DIMENSIONAL LINEAR REGRESSION MODELS
    Gohain, Prakash B.
    Jansson, Magnus
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 5515 - 5519
  • [50] BAYESIAN JOINT MODELING OF HIGH-DIMENSIONAL DISCRETE MULTIVARIATE LONGITUDINAL DATA USING GENERALIZED LINEAR MIXED MODELS
    Hauser, Paloma
    Tan, Xianming
    Chen, Fang
    Chen, Ronald c.
    Ibrahim, Joseph g.
    ANNALS OF APPLIED STATISTICS, 2024, 18 (03): : 2326 - 2341