TFMKC: Tuning-Free Multiple Kernel Clustering Coupled With Diverse Partition Fusion

被引:0
|
作者
Zhang, Junpu [1 ]
Li, Liang [1 ]
Zhang, Pei [1 ]
Liu, Yue [1 ]
Wang, Siwei [2 ]
Zhou, Changbao [3 ]
Liu, Xinwang [1 ]
Zhu, En [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha 410073, Peoples R China
[2] Intelligent Game & Decis Lab, Beijing 100071, Peoples R China
[3] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Kernel; Tuning; Fuses; Unsupervised learning; Pipelines; Costs; Optimization; Diverse fusion; ensemble learning; late fusion kernel learning; multiview clustering;
D O I
10.1109/TNNLS.2024.3435058
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Clustering is a popular research pipeline in unsupervised learning to find potential groupings. As a representative paradigm in multiple kernel clustering (MKC), late fusion-based models learn a consistent partition across multiple base kernels. Despite their promising performance, a common concern is the limited representation capacity caused by the inflexible fusion mechanism. Concretely, the representations are constrained by truncated- k Eigen-decomposition (EVD) without fully exploiting potential information. An intuitive idea to alleviate this concern is to generate a set of augmented partitions and then select the optimal partition by fine-tuning. However, this is overlimited by: 1) introducing undesired hyperparameters and dataset-related consequences; 2) neglecting rich information across diverse partitions; and 3) expensive parameter-tuning costs. To address these problems, we propose transforming the challenging problem of directly determining the optimal partition (optimal parameter) into a diverse partition fusion (parameter ensemble) problem. We design a novel flexible fusion mechanism called tuning-free multiple kernel clustering coupled with diverse partition fusion (TFMKC) by reweighting diverse partitions through optimization, achieving an optimal consensus partition by integrating diverse and complementary information rather than traditional fine-tuning, and distinguishing our work from existing methods. Extensive experiments verify that TFMKC achieves competitive effectiveness and efficiency over comparison baselines. The code can be accessed at https://github.com/ZJP/TFMKC.
引用
收藏
页数:14
相关论文
共 20 条
  • [1] Eigenvalue Ratio Inspired Partition Learning and Fusion for Multiple Kernel Clustering
    Yang, Wenqi
    Tang, Chang
    Zheng, Xiao
    Zhu, Xinzhong
    Liu, Xinwang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 8135 - 8147
  • [2] Tuning-free sparse clustering via alternating hard-thresholding
    Dong, Wei
    Xu, Chen
    Xie, Jinhan
    Tang, Niansheng
    JOURNAL OF MULTIVARIATE ANALYSIS, 2024, 203
  • [3] Late Fusion Multiple Kernel Clustering With Local Kernel Alignment Maximization
    Zhang, Tiejian
    Liu, Xinwang
    Gong, Lei
    Wang, Siwei
    Niu, Xin
    Shen, Li
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 993 - 1007
  • [4] Multiple Kernel Clustering With Adaptive Multi-Scale Partition Selection
    Wang, Jun
    Li, Zhenglai
    Tang, Chang
    Liu, Suyuan
    Wan, Xinhang
    Liu, Xinwang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6641 - 6652
  • [5] Late Fusion Multiple Kernel Clustering With Proxy Graph Refinement
    Wang, Siwei
    Liu, Xinwang
    Liu, Li
    Zhou, Sihang
    Zhu, En
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) : 4359 - 4370
  • [6] Multiple Kernel Clustering with Kernel k-Means Coupled Graph Tensor Learning
    Ren, Zhenwen
    Sun, Quansen
    Wei, Dong
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 9411 - 9418
  • [7] Multiple kernel clustering with late fusion consensus local graph preserving
    Zhang, Yujing
    Wang, Siwei
    Liu, Xinwang
    Zhu, En
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2021, 36 (12) : 7500 - 7521
  • [8] Multiple kernel clustering with late fusion consensus local graph preserving
    Zhu, En (enzhu@nudt.edu.cn), 1600, John Wiley and Sons Ltd (36):
  • [9] Efficient Multiple Kernel k-Means Clustering With Late Fusion
    Wang, Siwei
    Zhu, En
    Hu, Jingtao
    Li, Miaomiao
    Zhao, Kaikai
    Hu, Ning
    Liu, Xinwang
    IEEE ACCESS, 2019, 7 : 61109 - 61120
  • [10] Parameter-Free Shifted Laplacian Reconstruction for Multiple Kernel Clustering
    Xi Wu
    Zhenwen Ren
    F.Richard Yu
    IEEE/CAAJournalofAutomaticaSinica, 2024, 11 (04) : 1072 - 1074