Infrared and visible image fusion based on a two-stage fusion strategy and feature interaction block

被引:0
|
作者
Chen, Bingxin [1 ,2 ]
Luo, Shaojuan [3 ]
Chen, Meiyun [1 ]
Zhang, Fanlong [1 ,2 ]
He, Chunhua [1 ,2 ]
Wu, Heng [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Technol, Sch Chem Engn & Light Ind, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Neural network; Optical imaging; Image processing;
D O I
10.1016/j.optlaseng.2024.108461
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Infrared and visible image fusion technology (IVIFT) can combine the advantages of infrared and visible imaging systems and reduce the influence of particular environments, such as snow, darkness, fog, etc. Therefore, IVIFT is widely applied in security inspection, night monitoring, and remote sensing. However, many existing methods utilize a single-stage approach to optimize the model, which often causes weak robustness and an imbalance between the intensity and detail information. To solve this issue, we propose an infrared and visible image fusion method based on a two-stage fusion strategy and a feature interaction block (TFfusion). Specifically, a two-stage fusion strategy is developed to balance the salient target and the texture information retaining. The texture information is fused in Stage I, the salient targets are fused in Stage II, and Stage I guides Stage II in extracting texture information. A feature interaction block is designed to enhance the correlation between the source images and the fused image by sharing the features with each other. Quantitative and qualitative experiment results demonstrate that TFfusion achieves competitive performance and strong robustness in fusing the infrared and visible images compared with other advanced fusion methods.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Unified framework based on multiscale transform and feature learning for infrared and visible image fusion
    Fan, Zunlin
    Guan, Naiyang
    Wang, Zhiyuan
    Su, Longfei
    Wu, Jiangang
    Sun, Qianchong
    OPTICAL ENGINEERING, 2021, 60 (12)
  • [42] Infrared and visible image fusion based on infrared background suppression
    Yang, Yang
    Ren, Zhennan
    Li, Beichen
    Lang, Yue
    Pan, Xiaoru
    Li, Ruihai
    Ge, Ming
    OPTICS AND LASERS IN ENGINEERING, 2023, 164
  • [43] ASFFuse: Infrared and visible image fusion model based on adaptive selection feature maps
    Liu, Kuizhuang
    Li, Min
    Zuo, Enguang
    Chen, Chen
    Chen, Cheng
    Wang, Bo
    Wang, Yunling
    Lv, Xiaoyi
    PATTERN RECOGNITION, 2024, 149
  • [44] Infrared and visible image fusion based on relative total variation and multi feature decomposition
    Xu, Xiaoqing
    Ren, Long
    Liang, Xiaowei
    Liu, Xin
    INFRARED PHYSICS & TECHNOLOGY, 2025, 145
  • [45] Object matching of visible-infrared image based on attention mechanism and feature fusion
    Li, Wuxin
    Chen, Qian
    Gu, Guohua
    Sui, Xiubao
    PATTERN RECOGNITION, 2025, 158
  • [46] Feature dynamic alignment and refinement for infrared-visible image fusion: Translation robust fusion
    Li, Huafeng
    Zhao, Junzhi
    Li, Jinxing
    Yu, Zhengtao
    Lu, Guangming
    INFORMATION FUSION, 2023, 95 : 26 - 41
  • [47] Infrared image and visible image fusion based on wavelet transform
    Zhou, Zehua
    Tan, Min
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION APPLICATIONS (ICCIA 2012), 2012, : 886 - 890
  • [48] An Information Retention and Feature Transmission Network for Infrared and Visible Image Fusion
    Liu, Chang
    Yang, Bin
    Li, Yuehua
    Zhang, Xiaozhi
    Pang, Lihui
    IEEE SENSORS JOURNAL, 2021, 21 (13) : 14950 - 14959
  • [49] HFHFusion: A Heterogeneous Feature Highlighted method for infrared and visible image fusion
    Zheng, Yulong
    Zhao, Yan
    Chen, Jian
    Chen, Mo
    Yu, Jiaqi
    Wei, Jian
    Wang, Shigang
    OPTICS COMMUNICATIONS, 2024, 571
  • [50] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    Gao, Li
    Luo, Delin
    Wang, Song
    SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2024, 67 (02) : 408 - 422