Distributed testing on mutual independence of massive multivariate data

被引:1
|
作者
Kuang, Yongxin [1 ]
Xie, Junshan [1 ]
机构
[1] Henan Univ, Sch Math & Stat, Kaifeng 475000, Peoples R China
基金
中国国家自然科学基金;
关键词
Mutual independence; divide-and-conquer method; symmetric measure; computation complexity; DEPENDENCE;
D O I
10.1080/03610926.2021.2006232
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The article considers a distributed divide-and-conquer method to test the mutual independence between components of massive multivariate data. In particular, a new test statistic based on U-statistics by dividing the full data samples into disjoint blocks will be established. Some numerical simulations and real data analysis demonstrate that the proposed method is effective, and it can significantly reduce the computational complexity and save the running time of the test procedure on massive data inference.
引用
收藏
页码:5332 / 5348
页数:17
相关论文
共 50 条
  • [1] A distributed multiple sample testing for massive data
    Xie Xiaoyue
    Shi Jian
    Song Kai
    JOURNAL OF APPLIED STATISTICS, 2023, 50 (03) : 555 - 573
  • [2] Testing independence in high-dimensional multivariate normal data
    Najarzadeh, D.
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2021, 50 (14) : 3421 - 3435
  • [3] A new method of testing mutual independence
    Guo, Xiangyu
    Zhu, Fukang
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2024, 53 (17) : 6102 - 6115
  • [4] Data-Driven Representations for Testing Independence: A Connection with Mutual Information Estimation
    Gonzalez, Mauricio E.
    Silva, Jorge F.
    2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 1301 - 1306
  • [5] Fourier methods for testing multivariate independence
    Meintanis, Simos G.
    Iliopoulos, George
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2008, 52 (04) : 1884 - 1895
  • [6] Nonparametric independence testing via mutual information
    Berrett, T. B.
    Samworth, R. J.
    BIOMETRIKA, 2019, 106 (03) : 547 - 566
  • [7] Measures of concordance and testing of independence in multivariate structure
    Deng, Wenli
    Wang, Jinglong
    Zhang, Riquan
    JOURNAL OF MULTIVARIATE ANALYSIS, 2022, 191
  • [8] Tests of Multivariate Independence for Ordinal Data
    Quessy, Jean-Francois
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2009, 38 (19) : 3510 - 3531
  • [9] Mutual Transfer Learning for Massive Data
    Cheng, Ching-Wei
    Qiao, Xingye
    Cheng, Guang
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [10] Mutual Transfer Learning for Massive Data
    Cheng, Ching-Wei
    Qiao, Xingye
    Cheng, Guang
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,