Cross-Collaboration Weighted Fusion Network for RGB-T Salient Detection

被引:0
|
作者
Wang, Yumei [1 ]
Dongye, Changlei [1 ]
Zhao, Wenxiu [1 ]
机构
[1] Shandong Univ Sci & Technol, Huangdao, Peoples R China
关键词
Salient object detection; Illumination weights; Image quality; RGB-T;
D O I
10.1007/978-981-97-5591-2_26
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-T salient object detection (SOD) aims to accurately and effectively detect and segment salient objects by using the complementary information from RGB and thermal modalities. However, existing RGB-T SOD methods often overlook the fact that RGB and thermal images may not consistently aid in precise detection. To address this issue, we propose a novel approach called CWFNet for RGB-T SOD enhancing the model's adaptiveness in variable illumination scenarios. First of all, we introduce a global illumination learning module (GILM) to evaluate the illumination conditions. The generated illuminance weights not only adjust modality interaction but also serve to weaken the influence of undesirable modalities. Subsequently, in the encoding stage, guided by the illuminance weights, we design an RGB-guided fusion module (RFM) to complete early fusion of cross-modal features. In the decoding stage, we propose a thermal-guided localization supplement module (TLSM) to strengthen the perception of salient object locations. Extensive experiments are conducted on three benchmark RGBT datasets and compared to state-of-the-art methods. Our experimental results validate the superiority of our model in the RGB-T SOD task.
引用
收藏
页码:301 / 312
页数:12
相关论文
共 50 条
  • [31] Transformer-based cross-modality interaction guidance network for RGB-T salient object detection
    Luo, Jincheng
    Li, Yongjun
    Li, Bo
    Zhang, Xinru
    Li, Chaoyue
    Chenjin, Zhimin
    He, Jingyi
    Liang, Yifei
    NEUROCOMPUTING, 2024, 600
  • [32] CAE-Net: Cross-Modal Attention Enhancement Network for RGB-T Salient Object Detection
    Lv, Chengtao
    Wan, Bin
    Zhou, Xiaofei
    Sun, Yaoqi
    Hu, Ji
    Zhang, Jiyong
    Yan, Chenggang
    ELECTRONICS, 2023, 12 (04)
  • [33] GOSNet: RGB-T salient object detection network based on Global Omnidirectional Scanning
    Jiang, Bochang
    Luo, Dan
    Shang, Zihan
    Liu, Sicheng
    NEUROCOMPUTING, 2025, 630
  • [34] Saliency Prototype for RGB-D and RGB-T Salient Object Detection
    Zhang, Zihao
    Wang, Jie
    Han, Yahong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3696 - 3705
  • [35] Feature aggregation with transformer for RGB-T salient object detection
    Zhang, Ping
    Xu, Mengnan
    Zhang, Ziyan
    Gao, Pan
    Zhang, Jing
    NEUROCOMPUTING, 2023, 546
  • [36] Multi-enhanced Adaptive Attention Network for RGB-T Salient Object Detection
    Hao, Hao-Zhou
    Cheng, Yao
    Ji, Yi
    Li, Ying
    Liu, Chun-Ping
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [37] RGB-T salient object detection via CNN feature and result saliency map fusion
    Chang Xu
    Qingwu Li
    Mingyu Zhou
    Qingkai Zhou
    Yaqin Zhou
    Yunpeng Ma
    Applied Intelligence, 2022, 52 : 11343 - 11362
  • [38] Enabling modality interactions for RGB-T salient object detection
    Zhang, Qiang
    Xi, Ruida
    Xiao, Tonglin
    Huang, Nianchang
    Luo, Yongjiang
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [39] Scribble-Supervised RGB-T Salient Object Detection
    Liu, Zhengyi
    Huang, Xiaoshen
    Zhang, Guanghui
    Fang, Xianyong
    Wang, Linbo
    Tang, Bin
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2369 - 2374
  • [40] RGB-T salient object detection via CNN feature and result saliency map fusion
    Xu, Chang
    Li, Qingwu
    Zhou, Mingyu
    Zhou, Qingkai
    Zhou, Yaqin
    Ma, Yunpeng
    APPLIED INTELLIGENCE, 2022, 52 (10) : 11343 - 11362