A variational approach to the consistency of spectral clustering

被引:69
|
作者
Trillos, Nicolas Garcia [1 ]
Slepcev, Dejan [2 ]
机构
[1] Brown Univ, Div Appl Math, Providence, RI 02912 USA
[2] Carnegie Mellon Univ, Dept Math Sci, Pittsburgh, PA 15213 USA
基金
美国安德鲁·梅隆基金会; 美国国家科学基金会;
关键词
Spectral clustering; Graph Laplacian; Point cloud; Discrete to continuum limit; Gamma-convergence; Dirichlet energy; Random geometric graph; GRAPH; CONVERGENCE; LAPLACIAN;
D O I
10.1016/j.acha.2016.09.003
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper establishes the consistency of spectral approaches to data clustering. We consider clustering of point clouds obtained as samples of a ground-truth measure. A graph representing the point cloud is obtained by assigning weights to edges based on the distance between the points they connect. We investigate the spectral convergence of both unnormalized and normalized graph Laplacians towards the appropriate operators in the continuum domain. We obtain sharp conditions on how the connectivity radius can be scaled with respect to the number of sample points for the spectral convergence to hold. We also show that the discrete clusters obtained via spectral clustering converge towards a continuum partition of the ground truth measure. Such continuum partition minimizes a functional describing the continuum analogue of the graph-based spectral partitioning. Our approach, based on variational convergence, is general and flexible. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:239 / 281
页数:43
相关论文
共 50 条
  • [31] Membership embedding space approach and spectral clustering
    Rovetta, Stefano
    Masulli, Francesco
    Filippone, Maurizio
    KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS: KES 2007 - WIRN 2007, PT III, PROCEEDINGS, 2007, 4694 : 901 - +
  • [32] A spectral clustering approach for online and streaming applications
    Robles-Kelly, Antonio
    Wei, Ran
    Proceedings of the International Joint Conference on Neural Networks, 2017, 2017-May : 3904 - 3911
  • [33] New spectral linear placement and clustering approach
    Li, JM
    Lillis, J
    Liu, LT
    Cheng, CK
    33RD DESIGN AUTOMATION CONFERENCE, PROCEEDINGS 1996, 1996, : 88 - 93
  • [34] Snapshot Spectral Clustering - a costless approach to deep clustering ensembles generation
    Pirog, Adam
    Kwasnicka, Halina
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [35] The SpectACl of Nonconvex Clustering: A Spectral Approach to Density-Based Clustering
    Hess, Sibylle
    Duivesteijn, Wouter
    Honysz, Philipp
    Morik, Katharina
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 3788 - 3795
  • [36] Variational Approach to Percolation Threshold of Nanocomposites Considering Clustering Effect
    Xu, X. Frank
    Asce, A. M.
    Jie, Yuxin
    JOURNAL OF NANOMECHANICS AND MICROMECHANICS, 2014, 4 (02)
  • [37] Strong consistency guarantees for clustering high-dimensional bipartite graphs with the spectral method
    Braun, Guillaume
    ELECTRONIC JOURNAL OF STATISTICS, 2024, 18 (02): : 2798 - 2823
  • [38] Frequentist Consistency of Variational Bayes
    Wang, Yixin
    Blei, David M.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2019, 114 (527) : 1147 - 1161
  • [39] Ambiguity detection by fusion and conformity: A spectral clustering approach
    Porikli, F
    2005 INTERNATIONAL CONFERENCE ON INTEGRATION OF KNOWLEDGE INTENSIVE MULTI-AGENT SYSTEMS: KIMAS'05: MODELING, EXPLORATION, AND ENGINEERING, 2005, : 366 - 372
  • [40] A spectral approach to clustering numerical vectors as nodes in a network
    Shiga, Motoki
    Takigawa, Ichigaku
    Mamitsuka, Hiroshi
    PATTERN RECOGNITION, 2011, 44 (02) : 236 - 251