Communication Complexity of Distributed High Dimensional Correlation Testing

被引:0
|
作者
Sahasranand, K. R. [1 ]
Tyagi, Himanshu [1 ]
机构
[1] Indian Inst Sci, Dept Elect Commun Engn, Bengaluru 560012, India
关键词
Testing; Correlation; Protocols; Estimation; Random variables; Complexity theory; Information theory; Gaussian correlation; high-dimensional statistics; hypercontractivity; hypothesis testing; interactive communication; INFERENCE;
D O I
10.1109/TIT.2021.3091773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider a two-party distributed hypothesis testing problem for correlated Gaussian random variables. For a d-dimensional random vector X and a scalar random variable Y, where X and Y are jointly Gaussian with an unknown correlation vector rho, parties P-1 and P-2 observe independent copies of X and Y, respectively. The parties seek to test if their observations are correlated or not, namely they seek to test if parallel to rho parallel to(2) exceeds tau or is it 0. To that end, they communicate interactively and declare the test output. We show that roughly order d/tau(2) bits of communication are sufficient and necessary for resolving the distributed correlation testing problem above. Furthermore, we establish a lower bound of roughly d(2)/tau(2) bits for the communication needed for distributed estimation of rho, implying that distributed correlation testing requires less communication than distributed estimation. Both our lower bounds for testing and estimation hold for an arbitrary d and interactive communication with shared randomness, while our distributed test requires only one-way communication with shared randomness. For the one-dimensional case, with one-way communication and with probability of one of the error-types fixed, our bounds are more refined in the dependence on the other error- type and are tight even in the constant.
引用
收藏
页码:6082 / 6095
页数:14
相关论文
共 50 条
  • [21] ON THE AVERAGE COMMUNICATION COMPLEXITY OF ASYNCHRONOUS DISTRIBUTED ALGORITHMS
    TSITSIKLIS, JN
    STAMOULIS, GD
    JOURNAL OF THE ASSOCIATION FOR COMPUTING MACHINERY, 1995, 42 (02): : 382 - 400
  • [22] Communication Complexity of Approximate Matching in Distributed Graphs
    Huang, Zengfeng
    Radunovic, Bozidar
    Vojnovic, Milan
    Zhang, Qin
    32ND INTERNATIONAL SYMPOSIUM ON THEORETICAL ASPECTS OF COMPUTER SCIENCE (STACS 2015), 2015, 30 : 460 - 473
  • [23] Distributed communication complexity of spanning tree construction
    Vyalyi, M. N.
    Khuziev, I. M.
    PROBLEMS OF INFORMATION TRANSMISSION, 2015, 51 (01) : 49 - 65
  • [24] Communication Complexity of Distributed Convex Learning and Optimization
    Arjevani, Yossi
    Shamir, Ohad
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [25] On the average communication complexity of asynchronous distributed algorithms
    Massachusetts Inst of Technology, Cambridge, United States
    Journal of the ACM, 1995, 42 (02): : 382 - 400
  • [26] CONTROL COMMUNICATION COMPLEXITY OF DISTRIBUTED CONTROL SYSTEMS
    Wong, Wing Shing
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2009, 48 (03) : 1722 - 1742
  • [27] THE COMMUNICATION COMPLEXITY OF DISTRIBUTED EPSILON-APPROXIMATIONS
    Huang, Zengfeng
    Yi, Ke
    SIAM JOURNAL ON COMPUTING, 2017, 46 (04) : 1370 - 1394
  • [28] Distributed communication complexity of spanning tree construction
    M. N. Vyalyi
    I. M. Khuziev
    Problems of Information Transmission, 2015, 51 : 49 - 65
  • [29] Testing concurrency and communication in distributed objects
    Bader, A
    Sajeev, ASM
    Ramakrishnan, S
    FIFTH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, PROCEEDINGS, 1998, : 422 - 428
  • [30] Improving the Bit Complexity of Communication for Distributed Convex Optimization
    Ghadiri, Mehrdad
    Lee, Yin Tat
    Padmanabhan, Swati
    Swartworth, William
    Woodru, David P.
    Ye, Guanghao
    PROCEEDINGS OF THE 56TH ANNUAL ACM SYMPOSIUM ON THEORY OF COMPUTING, STOC 2024, 2024, : 1130 - 1140