Communication Complexity of Distributed High Dimensional Correlation Testing

被引:0
|
作者
Sahasranand, K. R. [1 ]
Tyagi, Himanshu [1 ]
机构
[1] Indian Inst Sci, Dept Elect Commun Engn, Bengaluru 560012, India
关键词
Testing; Correlation; Protocols; Estimation; Random variables; Complexity theory; Information theory; Gaussian correlation; high-dimensional statistics; hypercontractivity; hypothesis testing; interactive communication; INFERENCE;
D O I
10.1109/TIT.2021.3091773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider a two-party distributed hypothesis testing problem for correlated Gaussian random variables. For a d-dimensional random vector X and a scalar random variable Y, where X and Y are jointly Gaussian with an unknown correlation vector rho, parties P-1 and P-2 observe independent copies of X and Y, respectively. The parties seek to test if their observations are correlated or not, namely they seek to test if parallel to rho parallel to(2) exceeds tau or is it 0. To that end, they communicate interactively and declare the test output. We show that roughly order d/tau(2) bits of communication are sufficient and necessary for resolving the distributed correlation testing problem above. Furthermore, we establish a lower bound of roughly d(2)/tau(2) bits for the communication needed for distributed estimation of rho, implying that distributed correlation testing requires less communication than distributed estimation. Both our lower bounds for testing and estimation hold for an arbitrary d and interactive communication with shared randomness, while our distributed test requires only one-way communication with shared randomness. For the one-dimensional case, with one-way communication and with probability of one of the error-types fixed, our bounds are more refined in the dependence on the other error- type and are tight even in the constant.
引用
收藏
页码:6082 / 6095
页数:14
相关论文
共 50 条
  • [1] OPTIMAL HIGH-DIMENSIONAL AND NONPARAMETRIC DISTRIBUTED TESTING UNDER COMMUNICATION CONSTRAINTS
    Szabo, Botond
    Vuursteen, Lasse
    van Zanten, Harry
    ANNALS OF STATISTICS, 2023, 51 (03): : 909 - 934
  • [2] The communication complexity of correlation
    Harsha, Prahladh
    Jain, Rahul
    McAllester, David
    Radhakrishnan, Jaikumar
    TWENTY-SECOND ANNUAL IEEE CONFERENCE ON COMPUTATIONAL COMPLEXITY, PROCEEDINGS, 2007, : 10 - +
  • [3] The Communication complexity of correlation
    Toyota Technological Institute at Chicago , Chicago, IL 60637, United States
    不详
    不详
    不详
    不详
    IEEE Trans. Inf. Theory, 1 (438-449):
  • [4] The Communication Complexity of Correlation
    Harsha, Prahladh
    Jain, Rahul
    McAllester, David
    Radhakrishnan, Jaikumar
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (01) : 438 - 449
  • [5] The computational complexity of high-dimensional correlation search
    Jermaine, C
    2001 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2001, : 249 - 256
  • [6] The Communication Complexity of Distributed ε-Approximations
    Huang, Zengfeng
    Yi, Ke
    2014 55TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS 2014), 2014, : 591 - 600
  • [7] Optimal Distributed Composite Testing in High-Dimensional Gaussian Models With 1-Bit Communication
    Szabo, Botond
    Vuursteen, Lasse
    Van Zanten, Harry
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (06) : 4070 - 4084
  • [8] COMMUNICATION COMPLEXITY IN DISTRIBUTED ALGEBRAIC COMPUTATION
    LUO, ZQ
    TSITSIKLIS, JN
    PROCEEDINGS OF THE 28TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-3, 1989, : 899 - 900
  • [9] Control Communication Complexity of Distributed Actions
    Wong, Wing Shing
    Baillieul, John
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (11) : 2731 - 2745
  • [10] ON THE COMMUNICATION COMPLEXITY OF DISTRIBUTED ALGEBRAIC COMPUTATION
    LUO, ZQ
    TSITSIKLIS, JN
    JOURNAL OF THE ACM, 1993, 40 (05) : 1019 - 1047