Multi-scale attention and loss penalty mechanism for multi-view clustering

被引:0
|
作者
Wang, Tingyu [1 ,2 ]
Zhai, Rui [1 ,2 ]
Wang, Longge [1 ,2 ]
Yu, Junyang [1 ,2 ]
Li, Han [1 ,2 ]
Wang, Zhicheng [1 ,2 ]
Wu, Jinhu [1 ,2 ]
机构
[1] Henan Univ, Coll Software, Kaifeng 475004, Peoples R China
[2] Henan Prov Intelligent Data Proc Res Engn Res Ctr, Kaifeng 475004, Peoples R China
关键词
Multi-view clustering; Contrast learning; Loss penalty mechanism; Attention mechanism;
D O I
10.1007/s00530-024-01637-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep multi-view clustering effectively utilizes multidimensional perspective data, categorizing sample entities into their respective categories. Nonetheless, prevalent methodologies frequently exhibit inefficiency during the feature fusion phase, particularly in isolating pivotal features conducive to clustering. To address this problem, this paper proposes a multi-view clustering method based on multi-scale attention and loss penalty mechanism (MALPMVC). The MALPMVC method begins by utilizing an autoencoder to extract latent feature representations, then employs multi-scale attention to enhance the salience of channel features and spatial areas, thereby intensifying focus on significant feature channels and spatial areas. The loss penalty mechanism is then used to focus the model on hard-to-classify samples, improving the ability to learn discriminative features from hard-to-categorize samples. Finally, the obtained fused features are inputted into the data clustering module to divide the data samples into clusters. Extensive experiments have shown that the MALPMVC method surpasses 10 other competitive clustering approaches, such as CoMVC, MFLVC, and GCFAggMVC, in delivering superior performance. Furthermore, with an increase in the number of views, the model effectively counteracts the adverse influences of mutually exclusive views, successfully mitigating the detrimental effects associated with these conflicts. Particularly, in the Caltech-4V and Caltech-5V datasets, it outperforms the GCFAggMVC method by an impressive 12.36% and 9.21% in clustering accuracy, respectively.
引用
收藏
页数:15
相关论文
共 50 条
  • [11] Multi-view clustering based on view-attention driven
    Ma, Zhifeng
    Yu, Junyang
    Wang, Longge
    Chen, Huazhu
    Zhao, Yuxi
    He, Xin
    Wang, Yingqi
    Song, Yalin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (08) : 2621 - 2631
  • [12] Multi-view clustering based on view-attention driven
    Zhifeng Ma
    Junyang Yu
    Longge Wang
    Huazhu Chen
    Yuxi Zhao
    Xin He
    Yingqi Wang
    Yalin Song
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2621 - 2631
  • [13] Multi-Scale Geometric Consistency Guided Multi-View Stereo
    Xu, Qingshan
    Tao, Wenbing
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5478 - 5487
  • [14] Image Manipulation Detection by Multi-View Multi-Scale Supervision
    Chen, Xinru
    Dong, Chengbo
    Ji, Jiaqi
    Cao, Juan
    Li, Xirong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14165 - 14173
  • [15] Multi-scale and multi-view network for lung tumor segmentation
    Liu C.
    Liu H.
    Zhang X.
    Guo J.
    Lv P.
    Computers in Biology and Medicine, 2024, 172
  • [16] Multi-view clustering
    Bickel, S
    Scheffer, T
    FOURTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2004, : 19 - 26
  • [17] Deep multi-view subspace clustering via structure-preserved multi-scale features fusion
    Kaiqiang Xu
    Kewei Tang
    Zhixun Su
    Neural Computing and Applications, 2023, 35 : 3203 - 3219
  • [18] Multi-scale deep multi-view subspace clustering with self-weighting fusion and structure preserving
    Wang, Jiao
    Wu, Bin
    Ren, Zhenwen
    Zhang, Hongying
    Zhou, Yunhui
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [19] Deep multi-view subspace clustering via structure-preserved multi-scale features fusion
    Xu, Kaiqiang
    Tang, Kewei
    Su, Zhixun
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (04): : 3203 - 3219
  • [20] MVSI-Net: Multi-view attention and multi-scale feature interaction for brain tumor segmentation
    Sun, Junding
    Hu, Ming
    Wu, Xiaosheng
    Tang, Chaosheng
    Lahza, Husam
    Wang, Shuihua
    Zhang, Yudong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95