Multi-scale attention and loss penalty mechanism for multi-view clustering

被引:0
|
作者
Wang, Tingyu [1 ,2 ]
Zhai, Rui [1 ,2 ]
Wang, Longge [1 ,2 ]
Yu, Junyang [1 ,2 ]
Li, Han [1 ,2 ]
Wang, Zhicheng [1 ,2 ]
Wu, Jinhu [1 ,2 ]
机构
[1] Henan Univ, Coll Software, Kaifeng 475004, Peoples R China
[2] Henan Prov Intelligent Data Proc Res Engn Res Ctr, Kaifeng 475004, Peoples R China
关键词
Multi-view clustering; Contrast learning; Loss penalty mechanism; Attention mechanism;
D O I
10.1007/s00530-024-01637-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep multi-view clustering effectively utilizes multidimensional perspective data, categorizing sample entities into their respective categories. Nonetheless, prevalent methodologies frequently exhibit inefficiency during the feature fusion phase, particularly in isolating pivotal features conducive to clustering. To address this problem, this paper proposes a multi-view clustering method based on multi-scale attention and loss penalty mechanism (MALPMVC). The MALPMVC method begins by utilizing an autoencoder to extract latent feature representations, then employs multi-scale attention to enhance the salience of channel features and spatial areas, thereby intensifying focus on significant feature channels and spatial areas. The loss penalty mechanism is then used to focus the model on hard-to-classify samples, improving the ability to learn discriminative features from hard-to-categorize samples. Finally, the obtained fused features are inputted into the data clustering module to divide the data samples into clusters. Extensive experiments have shown that the MALPMVC method surpasses 10 other competitive clustering approaches, such as CoMVC, MFLVC, and GCFAggMVC, in delivering superior performance. Furthermore, with an increase in the number of views, the model effectively counteracts the adverse influences of mutually exclusive views, successfully mitigating the detrimental effects associated with these conflicts. Particularly, in the Caltech-4V and Caltech-5V datasets, it outperforms the GCFAggMVC method by an impressive 12.36% and 9.21% in clustering accuracy, respectively.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Multi-view Clustering: A Survey
    Yang, Yan
    Wang, Hao
    BIG DATA MINING AND ANALYTICS, 2018, 1 (02) : 83 - 107
  • [32] Collaborative Multi-View Clustering
    Ghassany, Mohamad
    Grozavu, Nistor
    Bennani, Younes
    2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [33] Multi-View Subspace Clustering
    Gao, Hongchang
    Nie, Feiping
    Li, Xuelong
    Huang, Heng
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 4238 - 4246
  • [34] Partial Multi-View Clustering
    Li, Shao-Yuan
    Jiang, Yuan
    Zhou, Zhi-Hua
    PROCEEDINGS OF THE TWENTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2014, : 1968 - 1974
  • [35] Multi-scale graph attention subspace clustering network
    Wang, Tong
    Wu, Junhua
    Zhang, Zhenquan
    Zhou, Wen
    Chen, Guang
    Liu, Shasha
    NEUROCOMPUTING, 2021, 459 : 302 - 314
  • [36] Interpretable multi-view clustering
    Jiang, Mudi
    Hu, Lianyu
    He, Zengyou
    Chen, Zhikui
    PATTERN RECOGNITION, 2025, 162
  • [37] Reliable Multi-View Clustering
    Tao, Hong
    Hou, Chenping
    Liu, Xinwang
    Yi, Dongyun
    Zhu, Jubo
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 4123 - 4130
  • [38] Binary Multi-View Clustering
    Zhang, Zheng
    Liu, Li
    Shen, Fumin
    Shen, Heng Tao
    Shao, Ling
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (07) : 1774 - 1782
  • [39] Continual Multi-view Clustering
    Wan, Xinhang
    Liu, Jiyuan
    Liang, Weixuan
    Liu, Xinwang
    Wen, Yi
    Zhu, En
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3676 - 3684
  • [40] Multi-Task Multi-View Clustering
    Zhang, Xiaotong
    Zhang, Xianchao
    Liu, Han
    Liu, Xinyue
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (12) : 3324 - 3338