共 50 条
CFRNet: Cross-Attention-Based Fusion and Refinement Network for Enhanced RGB-T Salient Object Detection
被引:0
|作者:
Deng, Biao
[1
,2
]
Liu, Di
[2
]
Cao, Yang
[2
]
Liu, Hong
[2
]
Yan, Zhiguo
[1
]
Chen, Hu
[2
]
机构:
[1] Dongfang Elect Autocontrol Engn Co LTD, Deyang 618000, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu 610000, Peoples R China
来源:
基金:
中国国家自然科学基金;
关键词:
RGB-T salient object detection;
RGB-thermal fusion;
cross-attention;
fusion and refinement;
D O I:
10.3390/s24227146
中图分类号:
O65 [分析化学];
学科分类号:
070302 ;
081704 ;
摘要:
Existing deep learning-based RGB-T salient object detection methods often struggle with effectively fusing RGB and thermal features. Therefore, obtaining high-quality features and fully integrating these two modalities are central research focuses. We developed an illumination prior-based coefficient predictor (MICP) to determine optimal interaction weights. We then designed a saliency-guided encoder (SG Encoder) to extract multi-scale thermal features incorporating saliency information. The SG Encoder guides the extraction of thermal features by leveraging their correlation with RGB features, particularly those with strong semantic relationships to salient object detection tasks. Finally, we employed a Cross-attention-based Fusion and Refinement Module (CrossFRM) to refine the fused features. The robust thermal features help refine the spatial focus of the fused features, aligning them more closely with salient objects. Experimental results demonstrate that our proposed approach can more accurately locate salient objects, significantly improving performance compared to 11 state-of-the-art methods.
引用
收藏
页数:14
相关论文