DBO-Net: Differentiable bi-level optimization network for multi-view clustering

被引:16
|
作者
Fang, Zihan [1 ,2 ]
Du, Shide [1 ,2 ]
Lin, Xincan [1 ,2 ]
Yang, Jinbin [1 ,2 ]
Wang, Shiping [1 ,2 ]
Shi, Yiqing [3 ]
机构
[1] Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
[2] Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent Inf, Fuzhou 350116, Peoples R China
[3] Fujian Normal Univ, Coll Photon & Elect Engn, Fuzhou 350117, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-view clustering; Interpretable deep learning; Bi-level optimization; Differentiable network; AFFINITY GRAPH; REPRESENTATION;
D O I
10.1016/j.ins.2023.01.071
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-view clustering on traditional optimization methods is derived from different theoretical frameworks, yet it may be inefficient in dealing with complex multi-view data compared to deep models. In contrast, deep multi-view clustering methods for implicit optimization have excellent feature abstraction ability but are inscrutable due to their black-box problem. However, very limited research was devoted to integrating the advantages of the above two types of methods to design an efficient method for multi-view clustering. Focusing on these problems, this paper proposes a differentiable bi-level optimization network (DBO-Net) for multi-view clustering, which is implemented by incorporating the traditional optimization method with deep learning to design an interpretable deep network. To enhance the representation capability, the proposed DBO-Net is constructed by stacking multiple explicit differentiable block networks to learn an interpretable consistent representation. Then all the learned parameters can be implicitly optimized through back-propagation, making the learned representation more suitable for the clustering task. Extensive experimental results validate that the strategy of bi-level optimization can effectively improve clustering performance and the proposed method is superior to the state-of-the-art clustering methods.
引用
收藏
页码:572 / 585
页数:14
相关论文
共 50 条
  • [1] Bi-level weighted multi-view clustering via hybrid particle swarm optimization
    Jiang, Bo
    Qiu, Feiyue
    Wang, Liping
    Zhang, Zhenjun
    INFORMATION PROCESSING & MANAGEMENT, 2016, 52 (03) : 387 - 398
  • [2] Differentiable Bi-Sparse Multi-View Co-Clustering
    Du, Shide
    Liu, Zhanghui
    Chen, Zhaoliang
    Yang, Wenyuan
    Wang, Shiping
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 4623 - 4636
  • [3] DMRL-Net: Differentiable Multi-view Representation Learning Network
    Fang, Zihan
    Du, Shide
    Chen, Yaqing
    Wang, Shiping
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1505 - 1510
  • [4] Differentiable Information Bottleneck for Deterministic Multi-view Clustering
    Yan, Xiaoqiang
    Jin, Zhixiang
    Han, Fengshou
    Ye, Yangdong
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 27425 - 27434
  • [5] DIMC-net: Deep Incomplete Multi-view Clustering Network
    Wen, Jie
    Zhang, Zheng
    Zhang, Zhao
    Wu, Zhihao
    Fei, Lunke
    Xu, Yong
    Zhang, Bob
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 3753 - 3761
  • [6] MVCIR-net: Multi-view Clustering Information Reinforcement Network
    Gu, Shaokui
    Yuan, Xu
    Zhao, Liang
    Liu, Zhenjiao
    Hu, Yan
    Chen, Zhikui
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3609 - 3618
  • [7] A Differentiable Perspective for Multi-View Spectral Clustering With Flexible Extension
    Lu, Zhoumin
    Nie, Feiping
    Wang, Rong
    Li, Xuelong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7087 - 7098
  • [8] Bi-Level Optimization in a Transport Network
    Stoilov, Todor
    Stoilova, Krasimira
    Papageorgiou, Markos
    Papamichail, Ioannis
    CYBERNETICS AND INFORMATION TECHNOLOGIES, 2015, 15 (05) : 37 - 49
  • [9] Multi-view Spectral Clustering Network
    Huang, Zhenyu
    Zhou, Joey Tianyi
    Peng, Xi
    Zhang, Changqing
    Zhu, Hongyuan
    Lv, Jiancheng
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2563 - 2569
  • [10] CCR-Net: Consistent contrastive representation network for multi-view clustering
    Lin, Renjie
    Lin, Yongkun
    Lin, Zhenghong
    Du, Shide
    Wang, Shiping
    INFORMATION SCIENCES, 2023, 637