Multi-scale attention and boundary enhancement with long-range dependency for salient object detection

被引:0
|
作者
Yu, Ming [1 ,2 ]
Lin, Xiaoqing [1 ]
Liu, Yi [2 ]
Guo, Yingchun [2 ]
机构
[1] Hebei Univ Technol, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hebei Univ Technol, Sch Artificial Intelligence, Tianjin, Peoples R China
关键词
Salient object detection; long-range dependencies; transformer encoder; cross-layer feature fusion; boundary enhancement module; NETWORK;
D O I
10.3233/JIFS-223726
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing saliency detection methods have achieved great progress in extracting multi-level features, however it is a challenging problem to catch accurate long-range dependencies that can enhance the accuracy of semantic information. To address this, a Transformer-based multi-scale attention and boundary enhancement with long-range dependency (MSBE) network is proposed in this paper. Amulti-scale attention enhancement module (MSAEM) is designed to reduce the redundant or noisy features and generate a high-quality feature representation by integrating multiple attentional features with diverse perspectives. The high-quality features are then fed into the triple Transformer encoder embedding module (TEM) to enhance high-level semantic features by learning long-range dependencies across layers. In the decoder part, a cross-layer feature fusion module (CLFFM) and boundary enhancement module (BEM) are designed to improve the effect of feature fusion and get accurate prediction results. Extensive experiments on six challenging public datasets demonstrate that the proposed method achieves competitive performance.
引用
收藏
页码:8957 / 8969
页数:13
相关论文
共 50 条
  • [1] Attention to the Scale : Deep Multi-Scale Salient Object Detection
    Zhang, Jing
    Dai, Yuchao
    Li, Bo
    He, Mingyi
    2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 105 - 111
  • [2] Salient object detection via multi-scale attention CNN
    Ji, Yuzhu
    Zhang, Haijun
    Wu, Q. M. Jonathan
    NEUROCOMPUTING, 2018, 322 : 130 - 140
  • [3] Multi-scale salient object detection network combining an attention mechanism
    Liu, Di
    Guo, Jichang
    Wang, Yudong
    Zhang, Yi
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2022, 49 (04): : 118 - 126
  • [4] Salient Object Detection Using Multi-Scale Features with Attention Recurrent Mechanism
    Lu S.
    Guo Q.
    Wang R.
    Zhang C.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (12): : 1926 - 1937
  • [5] Video Salient Object Detection Using Multi-Scale Self-Attention
    Liu, Jiahao (jiahao.liu@akane.waseda.jp), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [6] Multi-scale feature aggregation and boundary awareness network for salient object detection
    Wu, Qin
    Wang, Jianzhe
    Chai, Zhilei
    Guo, Guodong
    IMAGE AND VISION COMPUTING, 2022, 122
  • [7] Multi-scale contrast-based saliency enhancement for salient object detection
    Zhou, Wenhui
    Song, Teng
    Lin, Lili
    Lumsdaine, Andrew
    IET COMPUTER VISION, 2014, 8 (03) : 207 - 215
  • [8] Feature Enhancement and Multi-scale Cross-Modal Attention for RGB-D Salient Object Detection
    Wan, Xin
    Yang, Gang
    Zhou, Boyi
    Liu, Chang
    Wang, Hangxu
    Wang, Yutao
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 409 - 420
  • [9] Salient object detection network with multi-scale feature refinement and boundary feedback
    Zhang, Qing
    Li, Xiang
    IMAGE AND VISION COMPUTING, 2021, 116
  • [10] Semantic boundary enhancement and position attention network with long-range dependency for semantic segmentation
    Chen, Xi
    Han, Zhen
    Liu, Xiaoping
    Li, Zhiqiang
    Fang, Tao
    Huo, Hong
    Li, Qingli
    Zhu, Min
    Liu, Min
    Yuan, Haolei
    APPLIED SOFT COMPUTING, 2021, 109