Communication Complexity of Distributed High Dimensional Correlation Testing

被引:0
|
作者
Sahasranand, K. R. [1 ]
Tyagi, Himanshu [1 ]
机构
[1] Indian Inst Sci, Dept Elect Commun Engn, Bengaluru 560012, India
关键词
Testing; Correlation; Protocols; Estimation; Random variables; Complexity theory; Information theory; Gaussian correlation; high-dimensional statistics; hypercontractivity; hypothesis testing; interactive communication; INFERENCE;
D O I
10.1109/TIT.2021.3091773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider a two-party distributed hypothesis testing problem for correlated Gaussian random variables. For a d-dimensional random vector X and a scalar random variable Y, where X and Y are jointly Gaussian with an unknown correlation vector rho, parties P-1 and P-2 observe independent copies of X and Y, respectively. The parties seek to test if their observations are correlated or not, namely they seek to test if parallel to rho parallel to(2) exceeds tau or is it 0. To that end, they communicate interactively and declare the test output. We show that roughly order d/tau(2) bits of communication are sufficient and necessary for resolving the distributed correlation testing problem above. Furthermore, we establish a lower bound of roughly d(2)/tau(2) bits for the communication needed for distributed estimation of rho, implying that distributed correlation testing requires less communication than distributed estimation. Both our lower bounds for testing and estimation hold for an arbitrary d and interactive communication with shared randomness, while our distributed test requires only one-way communication with shared randomness. For the one-dimensional case, with one-way communication and with probability of one of the error-types fixed, our bounds are more refined in the dependence on the other error- type and are tight even in the constant.
引用
收藏
页码:6082 / 6095
页数:14
相关论文
共 50 条
  • [41] THE COMMUNICATION COMPLEXITY OF SET INTERSECTION AND MULTIPLE EQUALITY TESTING
    Huang, Dawei
    Pettie, Seth
    Zhang, Yixiang
    Zhang, Zhijun
    SIAM JOURNAL ON COMPUTING, 2021, 50 (02) : 674 - 717
  • [42] Property Testing Lower Bounds Via Communication Complexity
    Blais, Eric
    Brody, Joshua
    Matulef, Kevin
    2011 IEEE 26TH ANNUAL CONFERENCE ON COMPUTATIONAL COMPLEXITY (CCC), 2011, : 210 - 220
  • [43] PROPERTY TESTING LOWER BOUNDS VIA COMMUNICATION COMPLEXITY
    Blais, Eric
    Brody, Joshua
    Matulef, Kevin
    COMPUTATIONAL COMPLEXITY, 2012, 21 (02) : 311 - 358
  • [44] The Communication Complexity of Set Intersection and Multiple Equality Testing
    Huang, Dawei
    Pettie, Seth
    Zhang, Yixiang
    Zhang, Zhijun
    PROCEEDINGS OF THE 2020 ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, SODA, 2020, : 1715 - 1732
  • [45] Property Testing Lower Bounds via Communication Complexity
    Eric Blais
    Joshua Brody
    Kevin Matulef
    computational complexity, 2012, 21 : 311 - 358
  • [46] On The Multiparty Communication Complexity of Testing Triangle-Freeness
    Fischer, Orr
    Gershtein, Shay
    Oshman, Rotem
    PROCEEDINGS OF THE ACM SYMPOSIUM ON PRINCIPLES OF DISTRIBUTED COMPUTING (PODC'17), 2017, : 111 - 120
  • [47] HYPOTHESIS TESTING FOR BLOCK-STRUCTURED CORRELATION FOR HIGH-DIMENSIONAL VARIABLES
    Zheng, Shurong
    He, Xuming
    Guo, Jianhua
    STATISTICA SINICA, 2022, 32 (02) : 719 - 735
  • [48] Communication-Efficient Distributed Estimation of Causal Effects With High-Dimensional Data
    Wang, Xiaohan
    Tong, Jiayi
    Peng, Sida
    Chen, Yong
    Ning, Yang
    STAT, 2024, 13 (03):
  • [49] Communication-Efficient Distributed Learning for High-Dimensional Support Vector Machines
    Zhou, Xingcai
    Shen, Hao
    MATHEMATICS, 2022, 10 (07)
  • [50] LOWER BOUNDS ON COMMUNICATION COMPLEXITY IN DISTRIBUTED COMPUTER NETWORKS.
    Tiwari, Prasoon
    1600, (34):