Residual Attention-Based Image Fusion Method with Multi-Level Feature Encoding

被引:0
|
作者
Li, Hao [1 ,2 ]
Yang, Tiantian [2 ,3 ]
Wang, Runxiang [4 ]
Li, Cuichun [1 ]
Zhou, Shuyu [1 ]
Guo, Xiqing [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Technol & Engn Ctr Space Utilizat, Beijing 100094, Peoples R China
[4] Tianjin Univ, Sch Future Technol, Tianjin 300072, Peoples R China
关键词
image fusion; transformer; cross attention; deep learning; feature encoding; MULTISCALE TRANSFORM; NETWORK; FRAMEWORK; WAVELET;
D O I
10.3390/s25030717
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel image fusion method designed to enhance the integration of infrared and visible images through the use of a residual attention mechanism. The primary objective is to generate a fused image that effectively combines the thermal radiation information from infrared images with the detailed texture and background information from visible images. To achieve this, we propose a multi-level feature extraction and fusion framework that encodes both shallow and deep image features. In this framework, deep features are utilized as queries, while shallow features function as keys and values within a residual cross-attention module. This architecture enables a more refined fusion process by selectively attending to and integrating relevant information from different feature levels. Additionally, we introduce a dynamic feature preservation loss function to optimize the fusion process, ensuring the retention of critical details from both source images. Experimental results demonstrate that the proposed method outperforms existing fusion techniques across various quantitative metrics and delivers superior visual quality.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] Multi-Level Adaptive Attention Fusion Network for Infrared and Visible Image Fusion
    Hu, Ziming
    Kong, Quan
    Liao, Qing
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 366 - 370
  • [32] Multi-level image fusion
    Petrovic, V
    MULTISENSOR, MULTISOURCE INFORMATION FUSION: ARCHITECTURES, ALGORITHMS, AND APPLICATIONS 2003, 2003, 5099 : 87 - 96
  • [33] Damage Detection Method for Rail Surface Based on Multi-Level Feature Fusion
    Han Q.
    Liu J.
    Feng Q.
    Wang S.
    Dai P.
    Zhongguo Tiedao Kexue/China Railway Science, 2021, 42 (05): : 41 - 49
  • [34] An InSAR Interferogram Filtering Method Based on Multi-Level Feature Fusion CNN
    Yang, Wang
    He, Yi
    Yao, Sheng
    Zhang, Lifeng
    Cao, Shengpeng
    Wen, Zhiqing
    SENSORS, 2022, 22 (16)
  • [35] Action Recognition Method Based on Multi-Level Feature Fusion and Temporal Extension
    Wu, Haoyuan
    Xiong, Xin
    Min, Weidong
    Zhao, Haoyu
    Wang, Wenxiang
    Computer Engineering and Applications, 2023, 59 (07) : 134 - 142
  • [36] A Multi-Attention Network with Multi-Level Spatial-Spectral Feature Fusion Based on Band Selection for Hyperspectral Image Classification
    Liu, Yi (yiliuxd@foxmail.com), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [37] Remote Sensing Image Change Detection Based on Multi-Level Diversity Feature Fusion
    Xie, Honggang
    Ma, Wanjie
    IEEE ACCESS, 2024, 12 : 81495 - 81505
  • [38] Remote Sensing Image Segmentation Network Based on Multi-Level Feature Refinement and Fusion
    Jian Yongsheng
    Zhu Daming
    Fu Zhitao
    Wen Shiya
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (04)
  • [39] A multi-level feature-fusion-based approach to breast histopathological image classification
    Ding, Wei-Long
    Zhu, Xiao-Jie
    Zheng, Kui
    Liu, Jin-Long
    You, Qing-Hua
    BIOMEDICAL PHYSICS & ENGINEERING EXPRESS, 2022, 8 (05)
  • [40] Visible and infrared image fusion based on multi-level method and image contrast improvement
    Peng, Yiyue
    He, Weiji
    Gu, Guohua
    Tong, Tao
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2013, 42 (04): : 1095 - 1099