High dimensional covariance matrix estimation using multi-factor models from incomplete information

被引:0
|
作者
FangFang Xu
JianChao Huang
ZaiWen Wen
机构
[1] Shanghai Jiao Tong University,Department of Mathematics
[2] Peking University,Beijing International Center for Mathematical Research
来源
Science China Mathematics | 2015年 / 58卷
关键词
high dimensional covariance matrix estimation; multi-factor model; matrix completion; alternating direction method of multipliers; 15A83; 93C41; 62H12;
D O I
暂无
中图分类号
学科分类号
摘要
Covariance matrix plays an important role in risk management, asset pricing, and portfolio allocation. Covariance matrix estimation becomes challenging when the dimensionality is comparable or much larger than the sample size. A widely used approach for reducing dimensionality is based on multi-factor models. Although it has been well studied and quite successful in many applications, the quality of the estimated covariance matrix is often degraded due to a nontrivial amount of missing data in the factor matrix for both technical and cost reasons. Since the factor matrix is only approximately low rank or even has full rank, existing matrix completion algorithms are not applicable. We consider a new matrix completion paradigm using the factor models directly and apply the alternating direction method of multipliers for the recovery. Numerical experiments show that the nuclear-norm matrix completion approaches are not suitable but our proposed models and algorithms are promising.
引用
收藏
页码:829 / 844
页数:15
相关论文
共 50 条
  • [21] Pivotal variable detection of the covariance matrix and its application to high-dimensional factor models
    Zhao, Junlong
    Zhao, Hongyu
    Zhu, Lixing
    STATISTICS AND COMPUTING, 2018, 28 (04) : 775 - 793
  • [22] Pivotal variable detection of the covariance matrix and its application to high-dimensional factor models
    Junlong Zhao
    Hongyu Zhao
    Lixing Zhu
    Statistics and Computing, 2018, 28 : 775 - 793
  • [23] ON ESTIMATION OF THE POPULATION SPECTRAL DISTRIBUTION FROM A HIGH-DIMENSIONAL SAMPLE COVARIANCE MATRIX
    Bai, Zhidong
    Chen, Jiaqi
    Yao, Jianfeng
    AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2010, 52 (04) : 423 - 437
  • [24] Factorized estimation of high-dimensional nonparametric covariance models
    Zhang, Jian
    Li, Jie
    SCANDINAVIAN JOURNAL OF STATISTICS, 2022, 49 (02) : 542 - 567
  • [25] High-dimensional covariance matrix estimation using a low-rank and diagonal decomposition
    Wu, Yilei
    Qin, Yingli
    Zhu, Mu
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2020, 48 (02): : 308 - 337
  • [26] High Dimensional Inverse Covariance Matrix Estimation via Linear Programming
    Yuan, Ming
    JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 : 2261 - 2286
  • [27] COVARIANCE AND PRECISION MATRIX ESTIMATION FOR HIGH-DIMENSIONAL TIME SERIES
    Chen, Xiaohui
    Xu, Mengyu
    Wu, Wei Biao
    ANNALS OF STATISTICS, 2013, 41 (06): : 2994 - 3021
  • [28] The Sparse Matrix Transform for Covariance Estimation and Analysis of High Dimensional Signals
    Cao, Guangzhi
    Bachega, Leonardo R.
    Bouman, Charles A.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (03) : 625 - 640
  • [29] ROBUST ESTIMATION OF THE MEAN AND COVARIANCE MATRIX FOR HIGH DIMENSIONAL TIME SERIES
    Zhang, Danna
    STATISTICA SINICA, 2021, 31 (02) : 797 - 820
  • [30] Testing the Number of Common Factors by Bootstrapped Sample Covariance Matrix in High-Dimensional Factor Models
    Yu, Long
    Zhao, Peng
    Zhou, Wang
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024,