Multi-scale attention and loss penalty mechanism for multi-view clustering

被引:0
|
作者
Wang, Tingyu [1 ,2 ]
Zhai, Rui [1 ,2 ]
Wang, Longge [1 ,2 ]
Yu, Junyang [1 ,2 ]
Li, Han [1 ,2 ]
Wang, Zhicheng [1 ,2 ]
Wu, Jinhu [1 ,2 ]
机构
[1] Henan Univ, Coll Software, Kaifeng 475004, Peoples R China
[2] Henan Prov Intelligent Data Proc Res Engn Res Ctr, Kaifeng 475004, Peoples R China
关键词
Multi-view clustering; Contrast learning; Loss penalty mechanism; Attention mechanism;
D O I
10.1007/s00530-024-01637-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep multi-view clustering effectively utilizes multidimensional perspective data, categorizing sample entities into their respective categories. Nonetheless, prevalent methodologies frequently exhibit inefficiency during the feature fusion phase, particularly in isolating pivotal features conducive to clustering. To address this problem, this paper proposes a multi-view clustering method based on multi-scale attention and loss penalty mechanism (MALPMVC). The MALPMVC method begins by utilizing an autoencoder to extract latent feature representations, then employs multi-scale attention to enhance the salience of channel features and spatial areas, thereby intensifying focus on significant feature channels and spatial areas. The loss penalty mechanism is then used to focus the model on hard-to-classify samples, improving the ability to learn discriminative features from hard-to-categorize samples. Finally, the obtained fused features are inputted into the data clustering module to divide the data samples into clusters. Extensive experiments have shown that the MALPMVC method surpasses 10 other competitive clustering approaches, such as CoMVC, MFLVC, and GCFAggMVC, in delivering superior performance. Furthermore, with an increase in the number of views, the model effectively counteracts the adverse influences of mutually exclusive views, successfully mitigating the detrimental effects associated with these conflicts. Particularly, in the Caltech-4V and Caltech-5V datasets, it outperforms the GCFAggMVC method by an impressive 12.36% and 9.21% in clustering accuracy, respectively.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Multi-scale graph diffusion convolutional network for multi-view learning
    Wang, Shiping
    Li, Jiacheng
    Chen, Yuhong
    Wu, Zhihao
    Huang, Aiping
    Zhang, Le
    ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (06)
  • [22] Multi-View Object Retrieval via Multi-Scale Topic Models
    Hong, Richang
    Hu, Zhenzhen
    Wang, Ruxin
    Wang, Meng
    Tao, Dacheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (12) : 5814 - 5827
  • [23] Multi-Scale Multi-View Deep Feature Aggregation for Food Recognition
    Jiang, Shuqiang
    Min, Weiqing
    Liu, Linhu
    Luo, Zhengdong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 265 - 276
  • [24] Auto-attention mechanism for multi-view deep emb e dding clustering
    Diallo, Bassoma
    Hu, Jie
    Li, Tianrui
    Khan, Ghufran Ahmad
    Liang, Xinyan
    Wang, Hongjun
    PATTERN RECOGNITION, 2023, 143
  • [25] Multi-view graph convolutional networks with attention mechanism
    Yao, Kaixuan
    Liang, Jiye
    Liang, Jianqing
    Li, Ming
    Cao, Feilong
    ARTIFICIAL INTELLIGENCE, 2022, 307
  • [26] A Multi-View Multi-Scale Neural Network for Multi-Label ECG Classification
    Yang, Shunxiang
    Lian, Cheng
    Zeng, Zhigang
    Xu, Bingrong
    Zang, Junbin
    Zhang, Zhidong
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (03): : 648 - 660
  • [27] Multi-view Clustering Ensembles
    Xie, Xijiong
    Sun, Shiliang
    PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 51 - 56
  • [28] Multi-View Multiple Clustering
    Yao, Shixin
    Yu, Guoxian
    Wang, Jun
    Domeniconi, Carlotta
    Zhang, Xiangliang
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 4121 - 4127
  • [29] A Multi-Scale Detector Based on Attention Mechanism
    Zhou, Lukuan
    Wang, Wei
    Wang, Qiang
    Sheng, Biyun
    Yang, Wankou
    2020 35TH YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2020, : 110 - 115
  • [30] Multi-view Clustering: A Survey
    Yan Yang
    Hao Wang
    Big Data Mining and Analytics, 2018, 1 (02) : 83 - 107