Residual Attention-Based Image Fusion Method with Multi-Level Feature Encoding

被引:0
|
作者
Li, Hao [1 ,2 ]
Yang, Tiantian [2 ,3 ]
Wang, Runxiang [4 ]
Li, Cuichun [1 ]
Zhou, Shuyu [1 ]
Guo, Xiqing [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Technol & Engn Ctr Space Utilizat, Beijing 100094, Peoples R China
[4] Tianjin Univ, Sch Future Technol, Tianjin 300072, Peoples R China
关键词
image fusion; transformer; cross attention; deep learning; feature encoding; MULTISCALE TRANSFORM; NETWORK; FRAMEWORK; WAVELET;
D O I
10.3390/s25030717
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel image fusion method designed to enhance the integration of infrared and visible images through the use of a residual attention mechanism. The primary objective is to generate a fused image that effectively combines the thermal radiation information from infrared images with the detailed texture and background information from visible images. To achieve this, we propose a multi-level feature extraction and fusion framework that encodes both shallow and deep image features. In this framework, deep features are utilized as queries, while shallow features function as keys and values within a residual cross-attention module. This architecture enables a more refined fusion process by selectively attending to and integrating relevant information from different feature levels. Additionally, we introduce a dynamic feature preservation loss function to optimize the fusion process, ensuring the retention of critical details from both source images. Experimental results demonstrate that the proposed method outperforms existing fusion techniques across various quantitative metrics and delivers superior visual quality.
引用
收藏
页数:26
相关论文
共 50 条
  • [41] Remote Sensing Image Segmentation Method Based on Multi-Level Channel Attention
    Yu Shuai
    Wang Xili
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)
  • [42] Residual Attention-based Fusion for Video Classification
    Pouyanfar, Samira
    Wang, Tianyi
    Chen, Shu-Ching
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 478 - 480
  • [43] Multi-Level Fusion and Attention-Guided CNN for Image Dehazing
    Zhang, Xiaoqin
    Wang, Tao
    Luo, Wenhan
    Huang, Pengcheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (11) : 4162 - 4173
  • [44] Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion
    Kou, Qiqi
    Zhao, Jiamin
    Cheng, Deqiang
    Su, Zhen
    Zhu, Xingguang
    IEEE ACCESS, 2023, 11 : 59530 - 59541
  • [45] Enhancing Food Image Recognition by Multi-Level Fusion and the Attention Mechanism
    Chen, Zengzheng
    Wang, Jianxin
    Wang, Yeru
    FOODS, 2025, 14 (03)
  • [46] MLFFNet: Multi-level Feature Fusion Net for Underwater Image Enhancement
    Liu, Xiaodong
    Gao, Zhi
    Chen, Ben M.
    OCEANS 2019 MTS/IEEE SEATTLE, 2019,
  • [47] Feature radiance fields (FeRF): A multi-level feature fusion method with deep neural network for image synthesis
    Chen, Jubo
    Yu, Xiaosheng
    Wu, Chengdong
    Tian, Xiaolei
    Xu, Ke
    APPLIED SOFT COMPUTING, 2024, 167
  • [48] A Multi-Level Feature Fusion Network for Remote Sensing Image Segmentation
    Dong, Sijun
    Chen, Zhengchao
    SENSORS, 2021, 21 (04) : 1 - 18
  • [49] Attention-Based Bilinear Feature Fusion Method for Bearing Fault Diagnosis
    Wang, Daichao
    Li, Yibin
    Jia, Lei
    Song, Yan
    Wen, Tao
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2023, 28 (03) : 1695 - 1705
  • [50] Multi-level classifier design for tumor micro-image based on multi-feature fusion
    Gan Lan
    Meng Xiu-ming
    FBIE: 2008 INTERNATIONAL SEMINAR ON FUTURE BIOMEDICAL INFORMATION ENGINEERING, PROCEEDINGS, 2008, : 60 - 63