SPECTRAL CLUSTERING AND THE HIGH-DIMENSIONAL STOCHASTIC BLOCKMODEL

被引:530
|
作者
Rohe, Karl [1 ]
Chatterjee, Sourav [1 ]
Yu, Bin [1 ]
机构
[1] Univ Calif Berkeley, Dept Stat, Berkeley, CA 94720 USA
来源
ANNALS OF STATISTICS | 2011年 / 39卷 / 04期
基金
美国国家科学基金会;
关键词
Spectral clustering; latent space model; Stochastic Blockmodel; clustering; convergence of eigenvectors; principal components analysis; GRAPHS; ALGORITHM; EIGENVECTORS; CONSISTENCY; PREDICTION; MODEL;
D O I
10.1214/11-AOS887
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Networks or graphs can easily represent a diverse set of data sources that are characterized by interacting units or actors. Social networks, representing people who communicate with each other, are one example. Communities or clusters of highly connected actors form an essential feature in the structure of several empirical networks. Spectral clustering is a popular and computationally feasible method to discover these communities. The stochastic blockmodel [Social Networks 5 (1983) 109-137] is a social network model with well-defined communities; each node is a member of one community. For a network generated from the Stochastic Blockmodel, we bound the number of nodes "misclustered" by spectral clustering. The asymptotic results in this paper are the first clustering results that allow the number of clusters in the model to grow with the number of nodes, hence the name high-dimensional. In order to study spectral clustering under the stochastic blockmodel, we first show that under the more general latent space model, the eigenvectors of the normalized graph Laplacian asymptotically converge to the eigenvectors of a "population" normalized graph Laplacian. Aside from the implication for spectral clustering, this provides insight into a graph visualization technique. Our method of studying the eigenvectors of random matrices is original.
引用
收藏
页码:1878 / 1915
页数:38
相关论文
共 50 条
  • [1] Perfect clustering for stochastic blockmodel graphs via adjacency spectral embedding
    Lyzinski, Vince
    Sussman, Daniel L.
    Minh Tang
    Athreya, Avanti
    Priebe, Carey E.
    ELECTRONIC JOURNAL OF STATISTICS, 2014, 8 : 2905 - 2922
  • [2] Multiview Spectral Clustering of High-Dimensional Observational Data
    Roman-Messina, A.
    Castro-Arvizu, Claudia M.
    Castillo-Tapia, Alejandro
    Murillo-Aguirre, Erlan R.
    Rodriguez-Villalon, O.
    IEEE ACCESS, 2023, 11 : 115884 - 115893
  • [3] Spectral Clustering on Spherical Coordinates Under the Degree-Corrected Stochastic Blockmodel
    Passino, Francesco Sanna
    Heard, Nicholas A.
    Rubin-Delanchy, Patrick
    TECHNOMETRICS, 2022, 64 (03) : 346 - 357
  • [4] Spectral Clustering of High-dimensional Data via Nonnegative Matrix Factorization
    Wang, Shulin
    Chen, Fang
    Fang, Jianwen
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [5] Global and Local Structure Preservation for Nonlinear High-dimensional Spectral Clustering
    Wen, Guoqiu
    Zhu, Yonghua
    Chen, Linjun
    Zhan, Mengmeng
    Xie, Yangcai
    COMPUTER JOURNAL, 2021, 64 (07): : 993 - 1004
  • [6] Spectral Clustering by Subspace Randomization and Graph Fusion for High-Dimensional Data
    Cai, Xiaosha
    Huang, Dong
    Wang, Chang-Dong
    Kwoh, Chee-Keong
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 330 - 342
  • [7] Spectral clustering of high-dimensional data exploiting sparse representation vectors
    Wu, Sen
    Feng, Xiaodong
    Zhou, Wenjun
    NEUROCOMPUTING, 2014, 135 : 229 - 239
  • [8] High-dimensional data clustering
    Bouveyron, C.
    Girard, S.
    Schmid, C.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2007, 52 (01) : 502 - 519
  • [9] Clustering of high-dimensional observations
    Wang, Yong
    Modarres, Reza
    JOURNAL OF NONPARAMETRIC STATISTICS, 2024,
  • [10] Clustering High-Dimensional Data
    Masulli, Francesco
    Rovetta, Stefano
    CLUSTERING HIGH-DIMENSIONAL DATA, CHDD 2012, 2015, 7627 : 1 - 13