Infrared and visible image fusion based on a two-stage fusion strategy and feature interaction block

被引:0
|
作者
Chen, Bingxin [1 ,2 ]
Luo, Shaojuan [3 ]
Chen, Meiyun [1 ]
Zhang, Fanlong [1 ,2 ]
He, Chunhua [1 ,2 ]
Wu, Heng [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Technol, Sch Chem Engn & Light Ind, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Neural network; Optical imaging; Image processing;
D O I
10.1016/j.optlaseng.2024.108461
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Infrared and visible image fusion technology (IVIFT) can combine the advantages of infrared and visible imaging systems and reduce the influence of particular environments, such as snow, darkness, fog, etc. Therefore, IVIFT is widely applied in security inspection, night monitoring, and remote sensing. However, many existing methods utilize a single-stage approach to optimize the model, which often causes weak robustness and an imbalance between the intensity and detail information. To solve this issue, we propose an infrared and visible image fusion method based on a two-stage fusion strategy and a feature interaction block (TFfusion). Specifically, a two-stage fusion strategy is developed to balance the salient target and the texture information retaining. The texture information is fused in Stage I, the salient targets are fused in Stage II, and Stage I guides Stage II in extracting texture information. A feature interaction block is designed to enhance the correlation between the source images and the fused image by sharing the features with each other. Quantitative and qualitative experiment results demonstrate that TFfusion achieves competitive performance and strong robustness in fusing the infrared and visible images compared with other advanced fusion methods.
引用
收藏
页数:24
相关论文
共 50 条
  • [31] Infrared and visible image fusion based on contrast enhancement guided filter and infrared feature decomposition
    Zhang, Bozhi
    Gao, Meijing
    Chen, Pan
    Shang, Yucheng
    Li, Shiyu
    Bai, Yang
    Liao, Hongping
    Liu, Zehao
    Li, Zhilong
    INFRARED PHYSICS & TECHNOLOGY, 2022, 127
  • [32] Infrared and visible image fusion based on variational auto-encoder and infrared feature compensation
    Ren, Long
    Pan, Zhibin
    Cao, Jianzhong
    Liao, Jiawen
    INFRARED PHYSICS & TECHNOLOGY, 2021, 117
  • [33] Infrared and visible image fusion based on cross-modal extraction strategy
    Liu, Xiaowen
    Li, Jing
    Yang, Xin
    Huo, Hongtao
    INFRARED PHYSICS & TECHNOLOGY, 2022, 124
  • [34] A Novel Saliency-Based Decomposition Strategy for Infrared and Visible Image Fusion
    Qi, Biao
    Bai, Xiaotian
    Wu, Wei
    Zhang, Yu
    Lv, Hengyi
    Li, Guoning
    REMOTE SENSING, 2023, 15 (10)
  • [35] BCMFIFuse: A Bilateral Cross-Modal Feature Interaction-Based Network for Infrared and Visible Image Fusion
    Gao, Xueyan
    Liu, Shiguang
    REMOTE SENSING, 2024, 16 (17)
  • [36] A dual-encoder network based on multi-layer feature fusion for infrared and visible image fusion
    Huang, Shuying
    Wu, Xueqiang
    Yang, Yong
    Wan, Weiguo
    Wang, Xiaozheng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (10) : 4511 - 4520
  • [37] Image generation and constrained two-stage feature fusion for person re-identification
    Tao Zhang
    Xing Sun
    Xuan Li
    Zhengming Yi
    Applied Intelligence, 2021, 51 : 7679 - 7689
  • [38] Image generation and constrained two-stage feature fusion for person re-identification
    Zhang, Tao
    Sun, Xing
    Li, Xuan
    Yi, Zhengming
    APPLIED INTELLIGENCE, 2021, 51 (11) : 7679 - 7689
  • [39] Multimodal Image Fusion Algorithm Based on Two-stage Multiscale Decomposition
    Zhang, Lei
    Cheng, Yi-Yuan
    Li, Jing
    Wang, Zhi-She
    Ji, Lin-Na
    Liu, Wei
    Journal of Computers (Taiwan), 2024, 35 (05) : 15 - 33
  • [40] Dual-Attention-Based Feature Aggregation Network for Infrared and Visible Image Fusion
    Tang, Zhimin
    Xiao, Guobao
    Guo, Junwen
    Wang, Shiping
    Ma, Jiayi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72