Infrared and visible image fusion based on a two-stage fusion strategy and feature interaction block

被引:0
|
作者
Chen, Bingxin [1 ,2 ]
Luo, Shaojuan [3 ]
Chen, Meiyun [1 ]
Zhang, Fanlong [1 ,2 ]
He, Chunhua [1 ,2 ]
Wu, Heng [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Technol, Sch Chem Engn & Light Ind, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Neural network; Optical imaging; Image processing;
D O I
10.1016/j.optlaseng.2024.108461
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Infrared and visible image fusion technology (IVIFT) can combine the advantages of infrared and visible imaging systems and reduce the influence of particular environments, such as snow, darkness, fog, etc. Therefore, IVIFT is widely applied in security inspection, night monitoring, and remote sensing. However, many existing methods utilize a single-stage approach to optimize the model, which often causes weak robustness and an imbalance between the intensity and detail information. To solve this issue, we propose an infrared and visible image fusion method based on a two-stage fusion strategy and a feature interaction block (TFfusion). Specifically, a two-stage fusion strategy is developed to balance the salient target and the texture information retaining. The texture information is fused in Stage I, the salient targets are fused in Stage II, and Stage I guides Stage II in extracting texture information. A feature interaction block is designed to enhance the correlation between the source images and the fused image by sharing the features with each other. Quantitative and qualitative experiment results demonstrate that TFfusion achieves competitive performance and strong robustness in fusing the infrared and visible images compared with other advanced fusion methods.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] FTSFN: A Two-Stage Feature Transfer and Supplement Fusion Network for Infrared and Visible Image Fusion
    Huang, Shuying
    Kong, Xiangkai
    Yang, Yong
    Wan, Weiguo
    Song, Zixiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [2] A three-dimensional feature-based fusion strategy for infrared and visible image fusion
    Liu, Xiaowen
    Huo, Hongtao
    Yang, Xin
    Li, Jing
    PATTERN RECOGNITION, 2025, 157
  • [3] Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image
    Zhang, Yugui
    Zhai, Bo
    Wang, Gang
    Lin, Jianchu
    ELECTRONICS, 2023, 12 (14)
  • [4] Infrared and Visible Image Fusion Based on Sparse Feature
    Ding Wen-shan
    Bi Du-yan
    He Lin-yuan
    Fan Zun-lin
    Wu Dong-peng
    ACTA PHOTONICA SINICA, 2018, 47 (09)
  • [5] HF2TNet: A Hierarchical Fusion Two-Stage Training Network for Infrared and Visible Image Fusion
    Lv, Ting
    Ji, Chuanming
    Jiang, Hong
    Liu, Yu
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3164 - 3168
  • [6] Infrared and visible image fusion based on a two-stage class conditioned auto-encoder network
    Cao, Yanpeng
    Luo, Xing
    Tong, Xi
    Yang, Jiangxin
    Cao, Yanlong
    NEUROCOMPUTING, 2023, 544
  • [7] Interactive Image Segmentation Based on Fusion of Two-Stage Feature and Transformer Encoder
    Feng, Jun
    Zhang, Tian
    Shi, Yichen
    Wang, Hui
    Hu, Jingjing
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (06): : 831 - 843
  • [8] Infrared and Visible Image Fusion Based on Adaptive Feature Enhancement and Generator Path Interaction
    Yejun, Yang
    Gang, Liu
    Gang, Xiao
    Xinjie, Gu
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (14)
  • [9] FDFuse: Infrared and Visible Image Fusion Based on Feature Decomposition
    Cheng, Muhang
    Huang, Haiyan
    Liu, Xiangyu
    Mo, Hongwei
    Wu, Songling
    Zhao, Xiongbo
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [10] Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion
    Wang, Lei
    Hu, Ziming
    Kong, Quan
    Qi, Qian
    Liao, Qing
    ENTROPY, 2023, 25 (03)