Residual Attention-Based Image Fusion Method with Multi-Level Feature Encoding

被引:0
|
作者
Li, Hao [1 ,2 ]
Yang, Tiantian [2 ,3 ]
Wang, Runxiang [4 ]
Li, Cuichun [1 ]
Zhou, Shuyu [1 ]
Guo, Xiqing [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Technol & Engn Ctr Space Utilizat, Beijing 100094, Peoples R China
[4] Tianjin Univ, Sch Future Technol, Tianjin 300072, Peoples R China
关键词
image fusion; transformer; cross attention; deep learning; feature encoding; MULTISCALE TRANSFORM; NETWORK; FRAMEWORK; WAVELET;
D O I
10.3390/s25030717
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel image fusion method designed to enhance the integration of infrared and visible images through the use of a residual attention mechanism. The primary objective is to generate a fused image that effectively combines the thermal radiation information from infrared images with the detailed texture and background information from visible images. To achieve this, we propose a multi-level feature extraction and fusion framework that encodes both shallow and deep image features. In this framework, deep features are utilized as queries, while shallow features function as keys and values within a residual cross-attention module. This architecture enables a more refined fusion process by selectively attending to and integrating relevant information from different feature levels. Additionally, we introduce a dynamic feature preservation loss function to optimize the fusion process, ensuring the retention of critical details from both source images. Experimental results demonstrate that the proposed method outperforms existing fusion techniques across various quantitative metrics and delivers superior visual quality.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Attention-based Multi-level Feature Fusion for Named Entity Recognition
    Yang, Zhiwei
    Chen, Hechang
    Zhang, Jiawei
    Ma, Jing
    Chang, Yi
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3594 - 3600
  • [2] Attention-based interactive multi-level feature fusion for named entity recognition
    Xu, Yiwu
    Chen, Yun
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [3] UAM-Net: An Attention-Based Multi-level Feature Fusion UNet for Remote Sensing Image Segmentation
    Cao, Yiwen
    Jiang, Nanfeng
    Wang, Da-Han
    Wu, Yun
    Zhu, Shunzhi
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IV, 2024, 14428 : 267 - 278
  • [4] Attention-Based Multi-Level Feature Fusion for Object Detection in Remote Sensing Images
    Dong, Xiaohu
    Qin, Yao
    Gao, Yinghui
    Fu, Ruigang
    Liu, Songlin
    Ye, Yuanxin
    REMOTE SENSING, 2022, 14 (15)
  • [5] LOW-LIGHT IMAGE ENHANCEMENT WITH ATTENTION AND MULTI-LEVEL FEATURE FUSION
    Wang, Lei
    Fu, Guangtao
    Jiang, Zhuqing
    Ju, Guodong
    Men, Aidong
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 276 - 281
  • [6] A dual-structure attention-based multi-level feature fusion network for automatic surface defect detection
    Xiaoyu Zhang
    Jinping Zhang
    Jiusheng Chen
    Runxia Guo
    Jun Wu
    The Visual Computer, 2024, 40 : 2713 - 2732
  • [7] A dual-structure attention-based multi-level feature fusion network for automatic surface defect detection
    Zhang, Xiaoyu
    Zhang, Jinping
    Chen, Jiusheng
    Guo, Runxia
    Wu, Jun
    VISUAL COMPUTER, 2024, 40 (04): : 2713 - 2732
  • [8] A multi-level feature fusion method based on pooling and similarity for HRRS image retrieval
    Ge, Yun
    Yang, Zihong
    Huang, Zihan
    Ye, Famao
    REMOTE SENSING LETTERS, 2021, 12 (11) : 1090 - 1099
  • [9] Attention-based Multi-Level Fusion Network for Light Field Depth Estimation
    Chen, Jiaxin
    Zhang, Shuo
    Lin, Youfang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1009 - 1017
  • [10] A method for medical image retrieval using multi-level feature fusion
    Song, Weihua
    Han, Jing
    Hua, Tingting
    Journal of Information and Computational Science, 2009, 6 (02): : 967 - 974