CFRNet: Cross-Attention-Based Fusion and Refinement Network for Enhanced RGB-T Salient Object Detection

被引:0
|
作者
Deng, Biao [1 ,2 ]
Liu, Di [2 ]
Cao, Yang [2 ]
Liu, Hong [2 ]
Yan, Zhiguo [1 ]
Chen, Hu [2 ]
机构
[1] Dongfang Elect Autocontrol Engn Co LTD, Deyang 618000, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu 610000, Peoples R China
基金
中国国家自然科学基金;
关键词
RGB-T salient object detection; RGB-thermal fusion; cross-attention; fusion and refinement;
D O I
10.3390/s24227146
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Existing deep learning-based RGB-T salient object detection methods often struggle with effectively fusing RGB and thermal features. Therefore, obtaining high-quality features and fully integrating these two modalities are central research focuses. We developed an illumination prior-based coefficient predictor (MICP) to determine optimal interaction weights. We then designed a saliency-guided encoder (SG Encoder) to extract multi-scale thermal features incorporating saliency information. The SG Encoder guides the extraction of thermal features by leveraging their correlation with RGB features, particularly those with strong semantic relationships to salient object detection tasks. Finally, we employed a Cross-attention-based Fusion and Refinement Module (CrossFRM) to refine the fused features. The robust thermal features help refine the spatial focus of the fused features, aligning them more closely with salient objects. Experimental results demonstrate that our proposed approach can more accurately locate salient objects, significantly improving performance compared to 11 state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] PATNet: Patch-to-pixel attention-aware transformer network for RGB-D and RGB-T salient object detection
    Jiang, Mingfeng
    Ma, Jianhua
    Chen, Jiatong
    Wang, Yaming
    Fang, Xian
    KNOWLEDGE-BASED SYSTEMS, 2024, 291
  • [42] RGB-T salient object detection via CNN feature and result saliency map fusion
    Chang Xu
    Qingwu Li
    Mingyu Zhou
    Qingkai Zhou
    Yaqin Zhou
    Yunpeng Ma
    Applied Intelligence, 2022, 52 : 11343 - 11362
  • [43] DaCFN: divide-and-conquer fusion network for RGB-T object detection
    Wang, Bofan
    Zhao, Haitao
    Zhuang, Yi
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (07) : 2407 - 2420
  • [44] A multiple-attention refinement network for RGB-D salient object detection
    Jiang, Zijian
    Yu, Ling
    Li, Junru
    Niu, Fanglin
    IET IMAGE PROCESSING, 2024, 18 (14) : 4551 - 4562
  • [45] RGB-T salient object detection via CNN feature and result saliency map fusion
    Xu, Chang
    Li, Qingwu
    Zhou, Mingyu
    Zhou, Qingkai
    Zhou, Yaqin
    Ma, Yunpeng
    APPLIED INTELLIGENCE, 2022, 52 (10) : 11343 - 11362
  • [46] DaCFN: divide-and-conquer fusion network for RGB-T object detection
    Bofan Wang
    Haitao Zhao
    Yi Zhuang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2407 - 2420
  • [47] EAF-Net: an enhancement and aggregation–feedback network for RGB-T salient object detection
    Haiyang He
    Jing Wang
    Xiaolin Li
    Minglin Hong
    Shiguo Huang
    Tao Zhou
    Machine Vision and Applications, 2022, 33
  • [48] Feature differences reduction and specific features preserving network for RGB-T salient object detection
    Xu, Qiqi
    Di, Zhenguang
    Dong, Haoyu
    Yang, Gang
    IMAGE AND VISION COMPUTING, 2024, 152
  • [49] Wavelet-Driven Multi-Band Feature Fusion for RGB-T Salient Object Detection
    Zhao, Jianxun
    Wen, Xin
    He, Yu
    Yang, Xiaowei
    Song, Kechen
    Sensors, 2024, 24 (24)
  • [50] APNet: Adversarial Learning Assistance and Perceived Importance Fusion Network for All-Day RGB-T Salient Object Detection
    Zhou, Wujie
    Zhu, Yun
    Lei, Jingsheng
    Wan, Jian
    Yu, Lu
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (04): : 957 - 968