SPECTRAL CLUSTERING AND THE HIGH-DIMENSIONAL STOCHASTIC BLOCKMODEL

被引:528
|
作者
Rohe, Karl [1 ]
Chatterjee, Sourav [1 ]
Yu, Bin [1 ]
机构
[1] Univ Calif Berkeley, Dept Stat, Berkeley, CA 94720 USA
来源
ANNALS OF STATISTICS | 2011年 / 39卷 / 04期
基金
美国国家科学基金会;
关键词
Spectral clustering; latent space model; Stochastic Blockmodel; clustering; convergence of eigenvectors; principal components analysis; GRAPHS; ALGORITHM; EIGENVECTORS; CONSISTENCY; PREDICTION; MODEL;
D O I
10.1214/11-AOS887
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Networks or graphs can easily represent a diverse set of data sources that are characterized by interacting units or actors. Social networks, representing people who communicate with each other, are one example. Communities or clusters of highly connected actors form an essential feature in the structure of several empirical networks. Spectral clustering is a popular and computationally feasible method to discover these communities. The stochastic blockmodel [Social Networks 5 (1983) 109-137] is a social network model with well-defined communities; each node is a member of one community. For a network generated from the Stochastic Blockmodel, we bound the number of nodes "misclustered" by spectral clustering. The asymptotic results in this paper are the first clustering results that allow the number of clusters in the model to grow with the number of nodes, hence the name high-dimensional. In order to study spectral clustering under the stochastic blockmodel, we first show that under the more general latent space model, the eigenvectors of the normalized graph Laplacian asymptotically converge to the eigenvectors of a "population" normalized graph Laplacian. Aside from the implication for spectral clustering, this provides insight into a graph visualization technique. Our method of studying the eigenvectors of random matrices is original.
引用
收藏
页码:1878 / 1915
页数:38
相关论文
共 50 条
  • [21] Compressive Clustering of High-dimensional Data
    Ruta, Andrzej
    Porikli, Fatih
    2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 1, 2012, : 380 - 385
  • [22] Redefining clustering for high-dimensional applications
    Aggarwal, CC
    Yu, PS
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2002, 14 (02) : 210 - 225
  • [23] A Consistent Adjacency Spectral Embedding for Stochastic Blockmodel Graphs
    Sussman, Daniel L.
    Tang, Minh
    Fishkind, Donniell E.
    Priebe, Carey E.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2012, 107 (499) : 1119 - 1128
  • [24] Spectral clustering based on iterative optimization for large-scale and high-dimensional data
    Zhao, Yang
    Yuan, Yuan
    Nie, Feiping
    Wang, Qi
    NEUROCOMPUTING, 2018, 318 : 227 - 235
  • [25] An effective clustering scheme for high-dimensional data
    He, Xuansen
    He, Fan
    Fan, Yueping
    Jiang, Lingmin
    Liu, Runzong
    Maalla, Allam
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (15) : 45001 - 45045
  • [26] Approximated clustering of distributed high-dimensional data
    Kriegel, HP
    Kunath, P
    Pfeifle, M
    Renz, M
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2005, 3518 : 432 - 441
  • [27] High-Dimensional Clustering via Random Projections
    Laura Anderlucci
    Francesca Fortunato
    Angela Montanari
    Journal of Classification, 2022, 39 : 191 - 216
  • [28] Clustering High-Dimensional Noisy Categorical Data
    Tian, Zhiyi
    Xu, Jiaming
    Tang, Jen
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024, 119 (548) : 3008 - 3019
  • [29] High-Dimensional Clustering via Random Projections
    Anderlucci, Laura
    Fortunato, Francesca
    Montanari, Angela
    JOURNAL OF CLASSIFICATION, 2022, 39 (01) : 191 - 216
  • [30] Clustering and visualization of a high-dimensional diabetes dataset
    Lasek, Piotr
    Mei, Zhen
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KES 2019), 2019, 159 : 2179 - 2188