Infrared and visible image fusion based on a two-stage fusion strategy and feature interaction block

被引:0
|
作者
Chen, Bingxin [1 ,2 ]
Luo, Shaojuan [3 ]
Chen, Meiyun [1 ]
Zhang, Fanlong [1 ,2 ]
He, Chunhua [1 ,2 ]
Wu, Heng [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Technol, Sch Chem Engn & Light Ind, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Neural network; Optical imaging; Image processing;
D O I
10.1016/j.optlaseng.2024.108461
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Infrared and visible image fusion technology (IVIFT) can combine the advantages of infrared and visible imaging systems and reduce the influence of particular environments, such as snow, darkness, fog, etc. Therefore, IVIFT is widely applied in security inspection, night monitoring, and remote sensing. However, many existing methods utilize a single-stage approach to optimize the model, which often causes weak robustness and an imbalance between the intensity and detail information. To solve this issue, we propose an infrared and visible image fusion method based on a two-stage fusion strategy and a feature interaction block (TFfusion). Specifically, a two-stage fusion strategy is developed to balance the salient target and the texture information retaining. The texture information is fused in Stage I, the salient targets are fused in Stage II, and Stage I guides Stage II in extracting texture information. A feature interaction block is designed to enhance the correlation between the source images and the fused image by sharing the features with each other. Quantitative and qualitative experiment results demonstrate that TFfusion achieves competitive performance and strong robustness in fusing the infrared and visible images compared with other advanced fusion methods.
引用
收藏
页数:24
相关论文
共 50 条
  • [21] A Two-Branch Fusion Network for Infrared and Visible Image Fusion
    Zhang, Weihao
    Li, Zhilin
    Li, Bin
    Zhang, Mingliang
    PATTERN RECOGNITION AND COMPUTER VISION, PT IX, PRCV 2024, 2025, 15039 : 42 - 55
  • [22] Infrared and Visible Image Fusion Based on Adversarial Feature Extraction and Stable Image Reconstruction
    Su, Weijian
    Huang, Yongdong
    Li, Qiufu
    Zuo, Fengyuan
    Liu, Lijun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [23] Infrared and Visible Image Fusion Based on Multiclassification Adversarial Mechanism in Feature Space
    Zhang H.
    Ma J.
    Fan F.
    Huang J.
    Ma Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (03): : 690 - 704
  • [24] An infrared and visible image fusion method based on deep convolutional feature extraction
    Pang Z.-X.
    Liu G.-H.
    Chen C.-M.
    Liu H.-T.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (03): : 910 - 918
  • [25] Infrared and visible image fusion based on particle swarm optimization and dense block
    Zhang, Jing
    Tang, Bingjin
    Hu, Shuai
    FRONTIERS IN ENERGY RESEARCH, 2022, 10
  • [26] Review of Feature-Level Infrared and Visible Image Fusion
    Zhang, Honggang
    Yang, Haitao
    Zheng, Fengjie
    Wang, Jinyu
    Zhou, Xixuan
    Wang, Haoyu
    Xu, Yifan
    Computer Engineering and Applications, 2024, 60 (18) : 17 - 31
  • [27] VMDM-fusion: a saliency feature representation method for infrared and visible image fusion
    Yang, Yong
    Liu, Jia-Xiang
    Huang, Shu-Ying
    Lu, Hang-Yuan
    Wen, Wen-Ying
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (06) : 1221 - 1229
  • [28] VMDM-fusion: a saliency feature representation method for infrared and visible image fusion
    Yong Yang
    Jia-Xiang Liu
    Shu-Ying Huang
    Hang-Yuan Lu
    Wen-Ying Wen
    Signal, Image and Video Processing, 2021, 15 : 1221 - 1229
  • [29] An Infrared and Visible Image Fusion Framework based on Dual Scale Decomposition and Learnable Attention Fusion Strategy
    Cheng, Guanzheng
    Jin, Lizuo
    Chai, Lin
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4087 - 4092
  • [30] TWO-STAGE FUSION OF THERMAL HYPERSPECTRAL AND VISIBLE RGB IMAGE BY PCA AND GUIDED FILTER
    Liao, Wenzhi
    Huang, Xin
    Van Coillie, Frieke
    Thoonen, Guy
    Pizurica, Aleksandra
    Scheunders, Paul
    Philips, Wilfried
    2015 7TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2015,