A variational approach to the consistency of spectral clustering

被引:69
|
作者
Trillos, Nicolas Garcia [1 ]
Slepcev, Dejan [2 ]
机构
[1] Brown Univ, Div Appl Math, Providence, RI 02912 USA
[2] Carnegie Mellon Univ, Dept Math Sci, Pittsburgh, PA 15213 USA
基金
美国安德鲁·梅隆基金会; 美国国家科学基金会;
关键词
Spectral clustering; Graph Laplacian; Point cloud; Discrete to continuum limit; Gamma-convergence; Dirichlet energy; Random geometric graph; GRAPH; CONVERGENCE; LAPLACIAN;
D O I
10.1016/j.acha.2016.09.003
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper establishes the consistency of spectral approaches to data clustering. We consider clustering of point clouds obtained as samples of a ground-truth measure. A graph representing the point cloud is obtained by assigning weights to edges based on the distance between the points they connect. We investigate the spectral convergence of both unnormalized and normalized graph Laplacians towards the appropriate operators in the continuum domain. We obtain sharp conditions on how the connectivity radius can be scaled with respect to the number of sample points for the spectral convergence to hold. We also show that the discrete clusters obtained via spectral clustering converge towards a continuum partition of the ground truth measure. Such continuum partition minimizes a functional describing the continuum analogue of the graph-based spectral partitioning. Our approach, based on variational convergence, is general and flexible. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:239 / 281
页数:43
相关论文
共 50 条
  • [1] Consistency of spectral clustering
    von Luxburg, Ulrike
    Belkin, Mikhail
    Bousquet, Olivier
    ANNALS OF STATISTICS, 2008, 36 (02): : 555 - 586
  • [2] Consistency of regularized spectral clustering
    Cao, Ying
    Chen, Di-Rong
    APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2011, 30 (03) : 319 - 336
  • [3] On Consistency of Compressive Spectral Clustering
    Pydi, Muni Sreenivas
    Dukkipati, Ambedkar
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 2102 - 2106
  • [4] Consistency of anchor-based spectral clustering
    de Kergorlay, Henry-Louis
    Higham, Desmond J.
    INFORMATION AND INFERENCE-A JOURNAL OF THE IMA, 2022, 11 (03) : 801 - 822
  • [5] CONSISTENCY OF SPECTRAL CLUSTERING IN STOCHASTIC BLOCK MODELS
    Lei, Jing
    Rinaldo, Alessandro
    ANNALS OF STATISTICS, 2015, 43 (01): : 215 - 237
  • [6] Joint Spectral and Spatial Consistency Priors for Variational Pansharpening
    Liu, Pengfei
    IEEE ACCESS, 2019, 7 : 174847 - 174858
  • [7] Strong Consistency of Spectral Clustering for Stochastic Block Models
    Su, Liangjun
    Wang, Wuyi
    Zhang, Yichong
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (01) : 324 - 338
  • [8] A Variational Approach for Fusion of Panchromatic and Multispectral Images Using a New Spatial-Spectral Consistency Term
    Khateri, Mohammad
    Shabanzade, Fahim
    Mirzapour, Fardin
    Zaji, Amirhossein
    Liu, Zheng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 3421 - 3436
  • [9] A TOPOLOGICAL APPROACH TO SPECTRAL CLUSTERING
    Rieser, Antonio
    FOUNDATIONS OF DATA SCIENCE, 2021, 3 (01): : 49 - 66
  • [10] Multiview Approach to Spectral Clustering
    Kanaan-Izquierdo, Samir
    Ziyatdinov, Andrey
    Massanet, Raimon
    Perera, Alexandre
    2012 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2012, : 1254 - 1257