Multi-Exposure Image Fusion via Multi-Scale and Context-Aware Feature Learning

被引:9
|
作者
Liu, Yu [1 ,2 ]
Yang, Zhigang [1 ,2 ]
Cheng, Juan [1 ,2 ]
Chen, Xun [3 ]
机构
[1] Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Image fusion; Decoding; Transforms; Transformers; Visualization; Auto-encoder; global contextual information; multi-exposure image fusion; multi-scale features; Transformer; QUALITY ASSESSMENT;
D O I
10.1109/LSP.2023.3243767
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this letter, a deep learning (DL)-based multi-exposure image fusion (MEF) method via multi-scale and context-aware feature learning is proposed, aiming to overcome the defects of existing traditional and DL-based methods. The proposed network is based on an auto-encoder architecture. First, an encoder that combines the convolutional network and Transformer is designed to extract multi-scale features and capture the global contextual information. Then, a multi-scale feature interaction (MSFI) module is devised to enrich the scale diversity of extracted features using cross-scale fusion and Atrous spatial pyramid pooling (ASPP). Finally, a decoder with a nest connection architecture is introduced to reconstruct the fused image. Experimental results show that the proposed method outperforms several representative traditional and DL-based MEF methods in terms of both visual quality and objective assessment.
引用
收藏
页码:100 / 104
页数:5
相关论文
共 50 条
  • [11] Coarse-to-fine multi-scale attention-guided network for multi-exposure image fusion
    Zhao, Hao
    Zheng, Jingrun
    Shang, Xiaoke
    Zhong, Wei
    Liu, Jinyuan
    VISUAL COMPUTER, 2024, 40 (03): : 1697 - 1710
  • [12] Coarse-to-fine multi-scale attention-guided network for multi-exposure image fusion
    Hao Zhao
    Jingrun Zheng
    Xiaoke Shang
    Wei Zhong
    Jinyuan Liu
    The Visual Computer, 2024, 40 : 1697 - 1710
  • [13] MSCNNLP: A Multi-scale Convolutional Neural Network and Laplace Pyramid Method for Multi-exposure Image Fusion
    Zhu, JianJun
    Li, JiangJiang
    JOURNAL OF APPLIED SCIENCE AND ENGINEERING, 2020, 23 (03): : 563 - 569
  • [14] Unsupervised Multi-Exposure Image Fusion Breaking Exposure Limits via Contrastive Learning
    Xu, Han
    Liang, Haochen
    Ma, Jiayi
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3010 - 3017
  • [15] GALFusion: Multi-Exposure Image Fusion via a GlobalLocal Aggregation Learning Network
    Lei, Jia
    Li, Jiawei
    Liu, Jinyuan
    Zhou, Shihua
    Zhang, Qiang
    Kasabov, Nikola K.
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [16] Multi-scale Context-aware User Interest Learning for Behavior Pattern Modeling
    Deng, Zhiying
    Li, Jianjun
    Zou, Li
    Liu, Wei
    Shi, Si
    Chen, Qian
    Zhao, Juan
    Li, Guohui
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2024, PT 3, 2025, 14852 : 333 - 342
  • [17] Multi-Scale Feature Fusion and Advanced Representation Learning for Multi Label Image Classification
    Zhong, Naikang
    Lin, Xiao
    Du, Wen
    Shi, Jin
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03):
  • [18] Ghost-Free Multi-Exposure Image Fusion Technology Based on the Multi-Scale Block LBP Operator
    Ye, Xinrong
    Li, Zhengping
    Xu, Chao
    ELECTRONICS, 2022, 11 (19)
  • [19] Multi-Exposure Image Fusion Using Edge-Aware Network
    Aslam, Ghazala
    Imran, Muhammad
    Haq, Bushra
    Ullah, Anayat
    Elbasi, Ersin
    2022 17TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES (ICET'22), 2022, : 59 - 63
  • [20] Multi-exposure image fusion via deep perceptual enhancement
    Han, Dong
    Li, Liang
    Guo, Xiaojie
    Ma, Jiayi
    INFORMATION FUSION, 2022, 79 : 248 - 262