Multi-scale attention and loss penalty mechanism for multi-view clustering

被引:0
|
作者
Wang, Tingyu [1 ,2 ]
Zhai, Rui [1 ,2 ]
Wang, Longge [1 ,2 ]
Yu, Junyang [1 ,2 ]
Li, Han [1 ,2 ]
Wang, Zhicheng [1 ,2 ]
Wu, Jinhu [1 ,2 ]
机构
[1] Henan Univ, Coll Software, Kaifeng 475004, Peoples R China
[2] Henan Prov Intelligent Data Proc Res Engn Res Ctr, Kaifeng 475004, Peoples R China
关键词
Multi-view clustering; Contrast learning; Loss penalty mechanism; Attention mechanism;
D O I
10.1007/s00530-024-01637-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep multi-view clustering effectively utilizes multidimensional perspective data, categorizing sample entities into their respective categories. Nonetheless, prevalent methodologies frequently exhibit inefficiency during the feature fusion phase, particularly in isolating pivotal features conducive to clustering. To address this problem, this paper proposes a multi-view clustering method based on multi-scale attention and loss penalty mechanism (MALPMVC). The MALPMVC method begins by utilizing an autoencoder to extract latent feature representations, then employs multi-scale attention to enhance the salience of channel features and spatial areas, thereby intensifying focus on significant feature channels and spatial areas. The loss penalty mechanism is then used to focus the model on hard-to-classify samples, improving the ability to learn discriminative features from hard-to-categorize samples. Finally, the obtained fused features are inputted into the data clustering module to divide the data samples into clusters. Extensive experiments have shown that the MALPMVC method surpasses 10 other competitive clustering approaches, such as CoMVC, MFLVC, and GCFAggMVC, in delivering superior performance. Furthermore, with an increase in the number of views, the model effectively counteracts the adverse influences of mutually exclusive views, successfully mitigating the detrimental effects associated with these conflicts. Particularly, in the Caltech-4V and Caltech-5V datasets, it outperforms the GCFAggMVC method by an impressive 12.36% and 9.21% in clustering accuracy, respectively.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Multi-view and multi-scale behavior recognition algorithm based on attention mechanism
    Zhang, Di
    Chen, Chen
    Tan, Fa
    Qian, Beibei
    Li, Wei
    He, Xuan
    Lei, Susan
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [2] Multimodal speech emotion recognition based on multi-scale MFCCs and multi-view attention mechanism
    Lin Feng
    Lu-Yao Liu
    Sheng-Lan Liu
    Jian Zhou
    Han-Qing Yang
    Jie Yang
    Multimedia Tools and Applications, 2023, 82 : 28917 - 28935
  • [3] Multimodal speech emotion recognition based on multi-scale MFCCs and multi-view attention mechanism
    Feng, Lin
    Liu, Lu-Yao
    Liu, Sheng-Lan
    Zhou, Jian
    Yang, Han-Qing
    Yang, Jie
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (19) : 28917 - 28935
  • [4] Multi-Source Multi-View Clustering via Discrepancy Penalty
    Shao, Weixiang
    Zhang, Jiawei
    He, Lifang
    Yu, Philip S.
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 2714 - 2721
  • [5] Multi-view Remote Sensing Image Scene Classification by Fusing Multi-scale Attention
    Shi Y.
    Zhou W.
    Shao Z.
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2024, 49 (03): : 366 - 375
  • [6] Multi-view clustering with interactive mechanism
    Wu, Danyang
    Hu, Zhanxuan
    Nie, Feiping
    Wang, Rong
    Yang, Hui
    Li, Xuelong
    NEUROCOMPUTING, 2021, 449 : 378 - 388
  • [7] Composite attention mechanism network for deep contrastive multi-view clustering
    Du, Tingting
    Zheng, Wei
    Xu, Xingang
    NEURAL NETWORKS, 2024, 176
  • [8] Multi-view and Multi-scale Recognition of Symmetric Patterns
    Teferi, Dereje
    Bigun, Josef
    IMAGE ANALYSIS, PROCEEDINGS, 2009, 5575 : 657 - 666
  • [9] MMSMAPlus: a multi-view multi-scale multi-attention embedding model for protein function prediction
    Wang, Zhongyu
    Deng, Zhaohong
    Zhang, Wei
    Lou, Qiongdan
    Choi, Kup-Sze
    Wei, Zhisheng
    Wang, Lei
    Wu, Jing
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (04)
  • [10] An Equivalent Model of Wind Farm Based on Multivariate Multi-Scale Entropy and Multi-View Clustering
    Han, Ji
    Li, Li
    Song, Huihui
    Liu, Meng
    Song, Zongxun
    Qu, Yanbin
    ENERGIES, 2022, 15 (16)