Cross-Collaboration Weighted Fusion Network for RGB-T Salient Detection

被引:0
|
作者
Wang, Yumei [1 ]
Dongye, Changlei [1 ]
Zhao, Wenxiu [1 ]
机构
[1] Shandong Univ Sci & Technol, Huangdao, Peoples R China
关键词
Salient object detection; Illumination weights; Image quality; RGB-T;
D O I
10.1007/978-981-97-5591-2_26
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-T salient object detection (SOD) aims to accurately and effectively detect and segment salient objects by using the complementary information from RGB and thermal modalities. However, existing RGB-T SOD methods often overlook the fact that RGB and thermal images may not consistently aid in precise detection. To address this issue, we propose a novel approach called CWFNet for RGB-T SOD enhancing the model's adaptiveness in variable illumination scenarios. First of all, we introduce a global illumination learning module (GILM) to evaluate the illumination conditions. The generated illuminance weights not only adjust modality interaction but also serve to weaken the influence of undesirable modalities. Subsequently, in the encoding stage, guided by the illuminance weights, we design an RGB-guided fusion module (RFM) to complete early fusion of cross-modal features. In the decoding stage, we propose a thermal-guided localization supplement module (TLSM) to strengthen the perception of salient object locations. Extensive experiments are conducted on three benchmark RGBT datasets and compared to state-of-the-art methods. Our experimental results validate the superiority of our model in the RGB-T SOD task.
引用
收藏
页码:301 / 312
页数:12
相关论文
共 50 条
  • [21] Pyramid contract-based network for RGB-T salient object detection
    Ranwan Wu
    Hongbo Bi
    Cong Zhang
    Jiayuan Zhang
    Yuyu Tong
    Wei Jin
    Zhigang Liu
    Multimedia Tools and Applications, 2024, 83 : 20805 - 20825
  • [22] Lightweight Cross-Modal Information Mutual Reinforcement Network for RGB-T Salient Object Detection
    Lv, Chengtao
    Wan, Bin
    Zhou, Xiaofei
    Sun, Yaoqi
    Zhang, Jiyong
    Yan, Chenggang
    ENTROPY, 2024, 26 (02)
  • [23] CGMDRNet: Cross-Guided Modality Difference Reduction Network for RGB-T Salient Object Detection
    Chen, Gang
    Shao, Feng
    Chai, Xiongli
    Chen, Hangwei
    Jiang, Qiuping
    Meng, Xiangchao
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) : 6308 - 6323
  • [24] Pyramid contract-based network for RGB-T salient object detection
    Wu, Ranwan
    Bi, Hongbo
    Zhang, Cong
    Zhang, Jiayuan
    Tong, Yuyu
    Jin, Wei
    Liu, Zhigang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (07) : 20805 - 20825
  • [25] Interactive context-aware network for RGB-T salient object detection
    Wang, Yuxuan
    Dong, Feng
    Zhu, Jinchao
    Chen, Jianren
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (28) : 72153 - 72174
  • [26] Transformer-Based Cross-Modal Integration Network for RGB-T Salient Object Detection
    Lv, Chengtao
    Zhou, Xiaofei
    Wan, Bin
    Wang, Shuai
    Sun, Yaoqi
    Zhang, Jiyong
    Yan, Chenggang
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (02) : 4741 - 4755
  • [27] WaveNet: Wavelet Network With Knowledge Distillation for RGB-T Salient Object Detection
    Zhou, Wujie
    Sun, Fan
    Jiang, Qiuping
    Cong, Runmin
    Hwang, Jenq-Neng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 3027 - 3039
  • [28] MFENet: Multitype fusion and enhancement network for detecting salient objects in RGB-T images
    Wu J.
    Zhou W.
    Qian X.
    Lei J.
    Yu L.
    Luo T.
    Digital Signal Processing: A Review Journal, 2023, 133
  • [29] MSEDNet: Multi-scale fusion and edge-supervised network for RGB-T salient object detection
    Peng, Daogang
    Zhou, Weiyi
    Pan, Junzhen
    Wang, Danhao
    NEURAL NETWORKS, 2024, 171 : 410 - 422
  • [30] Adaptive interactive network for RGB-T salient object detection with double mapping transformer
    Dong, Feng
    Wang, Yuxuan
    Zhu, Jinchao
    Li, Yuehua
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (20) : 59169 - 59193