Communication-efficient estimation of quantile matrix regression for massive datasets

被引:2
|
作者
Yang, Yaohong [1 ]
Wang, Lei [1 ]
Liu, Jiamin [2 ]
Li, Rui [3 ]
Lian, Heng [4 ]
机构
[1] Nankai Univ, Sch Stat & Data Sci, KLMDASR, LEBPS & LPMC, Tianjin, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Math & Phys, Beijing, Peoples R China
[3] Shanghai Univ Int Business & Econ, Sch Stat & Informat, Shanghai, Peoples R China
[4] City Univ Hong Kong, Dept Math, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Communication-efficient surrogate loss; Distributed estimator; Divide and conquer; Empirical processes; High-dimensional matrix regression; ALGORITHM;
D O I
10.1016/j.csda.2023.107812
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In modern scientific applications, more and more data sets contain natural matrix predictors and traditional regression methods are not directly applicable. Matrix regression has been adapted to such data structure and received increasing attention in recent years. In this paper, we consider estimation of the conditional quantile in high-dimensional regularized matrix regression with a nuclear norm penalty and establish the convergence rate of the estimator. In order to construct a quantile matrix regression estimator in the distributed setting or for massive data sets, we propose a regularized communication efficient surrogate loss (CSL) function. The proposed CSL method only needs the worker machines to compute the gradient based on local data and the central machine solves a regularized estimation problem. We prove that the estimation error based on the proposed CSL method matches the estimation error bound of the centralized method that analyzes the entire data set. An alternating direction method of multipliers algorithm is developed to efficiently obtain the distributed CSL estimator. The finite-sample performance of the proposed estimator is studied through simulations and an application to Beijing Air Quality data set.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Communication-Efficient Decentralized Subspace Estimation
    Jiao, Yuchen
    Gu, Yuantao
    IEEE Journal on Selected Topics in Signal Processing, 2022, 16 (03): : 516 - 531
  • [22] Communication-Efficient Accurate Statistical Estimation
    Fan, Jianqing
    Guo, Yongyi
    Wang, Kaizheng
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (542) : 1000 - 1010
  • [23] Communication-Efficient Decentralized Subspace Estimation
    Jiao, Yuchen
    Gu, Yuantao
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (03) : 516 - 531
  • [24] Efficient Estimation for Censored Quantile Regression
    Lee, Sze Ming
    Sit, Tony
    Xu, Gongjun
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (544) : 2762 - 2775
  • [25] Communication-Efficient Federated Learning For Massive MIMO Systems
    Mu, Yuchen
    Garg, Navneet
    Ratnarajah, Tharmalingam
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 578 - 583
  • [26] Communication-efficient distributed precoding design for Massive MIMO
    Li M.
    Li Y.
    Zhang Z.
    Shi Q.
    Tongxin Xuebao/Journal on Communications, 2023, 44 (08): : 37 - 48
  • [27] HAC Covariance Matrix Estimation in Quantile Regression
    Galvao, Antonio F.
    Yoon, Jungmo
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024, 119 (547) : 2305 - 2316
  • [28] Private and Communication-Efficient Algorithms for Entropy Estimation
    Bravo-Hermsdorff, Gecia
    Busa-Fekete, Robert
    Ghavamzadeh, Mohammad
    Medina, Andres Munoz
    Syed, Umar
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [29] Communication-efficient estimation for distributed subset selection
    Chen, Yan
    Dong, Ruipeng
    Wen, Canhong
    STATISTICS AND COMPUTING, 2023, 33 (06)
  • [30] CREDO : A Communication-Efficient Distributed Estimation Algorithm
    Sahu, Anit Kumar
    Jakovetic, Dusan
    Kar, Soummya
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 516 - 520