Cross-Collaboration Weighted Fusion Network for RGB-T Salient Detection

被引:0
|
作者
Wang, Yumei [1 ]
Dongye, Changlei [1 ]
Zhao, Wenxiu [1 ]
机构
[1] Shandong Univ Sci & Technol, Huangdao, Peoples R China
关键词
Salient object detection; Illumination weights; Image quality; RGB-T;
D O I
10.1007/978-981-97-5591-2_26
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-T salient object detection (SOD) aims to accurately and effectively detect and segment salient objects by using the complementary information from RGB and thermal modalities. However, existing RGB-T SOD methods often overlook the fact that RGB and thermal images may not consistently aid in precise detection. To address this issue, we propose a novel approach called CWFNet for RGB-T SOD enhancing the model's adaptiveness in variable illumination scenarios. First of all, we introduce a global illumination learning module (GILM) to evaluate the illumination conditions. The generated illuminance weights not only adjust modality interaction but also serve to weaken the influence of undesirable modalities. Subsequently, in the encoding stage, guided by the illuminance weights, we design an RGB-guided fusion module (RFM) to complete early fusion of cross-modal features. In the decoding stage, we propose a thermal-guided localization supplement module (TLSM) to strengthen the perception of salient object locations. Extensive experiments are conducted on three benchmark RGBT datasets and compared to state-of-the-art methods. Our experimental results validate the superiority of our model in the RGB-T SOD task.
引用
收藏
页码:301 / 312
页数:12
相关论文
共 50 条
  • [41] DaCFN: divide-and-conquer fusion network for RGB-T object detection
    Wang, Bofan
    Zhao, Haitao
    Zhuang, Yi
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (07) : 2407 - 2420
  • [42] EAF-Net: an enhancement and aggregation–feedback network for RGB-T salient object detection
    Haiyang He
    Jing Wang
    Xiaolin Li
    Minglin Hong
    Shiguo Huang
    Tao Zhou
    Machine Vision and Applications, 2022, 33
  • [43] APNet: Adversarial Learning Assistance and Perceived Importance Fusion Network for All-Day RGB-T Salient Object Detection
    Zhou, Wujie
    Zhu, Yun
    Lei, Jingsheng
    Wan, Jian
    Yu, Lu
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (04): : 957 - 968
  • [44] DaCFN: divide-and-conquer fusion network for RGB-T object detection
    Bofan Wang
    Haitao Zhao
    Yi Zhuang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2407 - 2420
  • [45] Feature differences reduction and specific features preserving network for RGB-T salient object detection
    Xu, Qiqi
    Di, Zhenguang
    Dong, Haoyu
    Yang, Gang
    IMAGE AND VISION COMPUTING, 2024, 152
  • [46] Efficient Context-Guided Stacked Refinement Network for RGB-T Salient Object Detection
    Huo, Fushuo
    Zhu, Xuegui
    Zhang, Lei
    Liu, Qifeng
    Shu, Yu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 3111 - 3124
  • [47] Wavelet-Driven Multi-Band Feature Fusion for RGB-T Salient Object Detection
    Zhao, Jianxun
    Wen, Xin
    He, Yu
    Yang, Xiaowei
    Song, Kechen
    Sensors, 2024, 24 (24)
  • [48] Transformer-based Adaptive Interactive Promotion Network for RGB-T Salient Object Detection
    Zhu, Jinchao
    Zhang, Xiaoyu
    Dong, Feng
    Yan, Siyu
    Meng, Xianbang
    Li, Yuehua
    Tan, Panlong
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1989 - 1994
  • [49] UMINet: a unified multi-modality interaction network for RGB-D and RGB-T salient object detection
    Gao, Lina
    Fu, Ping
    Xu, Mingzhu
    Wang, Tiantian
    Liu, Bing
    VISUAL COMPUTER, 2024, 40 (03): : 1565 - 1582
  • [50] UMINet: a unified multi-modality interaction network for RGB-D and RGB-T salient object detection
    Lina Gao
    Ping Fu
    Mingzhu Xu
    Tiantian Wang
    Bing Liu
    The Visual Computer, 2024, 40 : 1565 - 1582