Multi-Exposure Image Fusion via Multi-Scale and Context-Aware Feature Learning

被引:9
|
作者
Liu, Yu [1 ,2 ]
Yang, Zhigang [1 ,2 ]
Cheng, Juan [1 ,2 ]
Chen, Xun [3 ]
机构
[1] Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Image fusion; Decoding; Transforms; Transformers; Visualization; Auto-encoder; global contextual information; multi-exposure image fusion; multi-scale features; Transformer; QUALITY ASSESSMENT;
D O I
10.1109/LSP.2023.3243767
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this letter, a deep learning (DL)-based multi-exposure image fusion (MEF) method via multi-scale and context-aware feature learning is proposed, aiming to overcome the defects of existing traditional and DL-based methods. The proposed network is based on an auto-encoder architecture. First, an encoder that combines the convolutional network and Transformer is designed to extract multi-scale features and capture the global contextual information. Then, a multi-scale feature interaction (MSFI) module is devised to enrich the scale diversity of extracted features using cross-scale fusion and Atrous spatial pyramid pooling (ASPP). Finally, a decoder with a nest connection architecture is introduced to reconstruct the fused image. Experimental results show that the proposed method outperforms several representative traditional and DL-based MEF methods in terms of both visual quality and objective assessment.
引用
收藏
页码:100 / 104
页数:5
相关论文
共 50 条
  • [41] CDMC-Net: Context-Aware Image Deblurring Using a Multi-scale Cascaded Network
    Qian Zhao
    Dongming Zhou
    Hao Yang
    Neural Processing Letters, 2023, 55 : 3985 - 4006
  • [42] Enhancing Medical Image Classification With Context Modulated Attention and Multi-Scale Feature Fusion
    Zhang, Renhan
    Luo, Xuegang
    Lv, Junrui
    Cao, Junyang
    Zhu, Yangping
    Wang, Juan
    Zheng, Bochuan
    IEEE ACCESS, 2025, 13 : 15226 - 15243
  • [43] Multi-Exposure Image Fusion via Deformable Self-Attention
    Luo, Jun
    Ren, Wenqi
    Gao, Xinwei
    Cao, Xiaochun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1529 - 1540
  • [44] EMEF: Ensemble Multi-Exposure Image Fusion
    Liu, Renshuai
    Li, Chengyang
    Cao, Haitao
    Zheng, Yinglin
    Zeng, Ming
    Cheng, Xuan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 1710 - 1718
  • [45] Detail preserving multi-exposure image fusion
    Li W.-Z.
    Yi B.-S.
    Qiu K.
    Peng H.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2016, 24 (09): : 2283 - 2292
  • [46] A new multi-exposure image fusion method
    Yang, Longpei
    Jiang, Chunhua
    Rao, Yunbo
    Lu, Linlin
    Chen, Ping
    Shao, Jun
    Journal of Computational Information Systems, 2015, 11 (09): : 3245 - 3256
  • [47] Single Image Dehazing via Saliency Weighted Multi-exposure Fusion
    Li Hongyun
    Shi Yun
    Gao Yin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (01) : 261 - 270
  • [48] Multi-scale context-aware network for continuous sign language recognition
    Senhua XUE
    Liqing GAO
    Liang WAN
    Wei FENG
    虚拟现实与智能硬件(中英文), 2024, 6 (04) : 323 - 337
  • [49] Context-Aware Multi-Scale Aggregation Network for Congested Crowd Counting
    Huang, Liangjun
    Shen, Shihui
    Zhu, Luning
    Shi, Qingxuan
    Zhang, Jianwei
    SENSORS, 2022, 22 (09)
  • [50] Multi-scale inputs and context-aware aggregation network for stereo matching
    Shi, Liqing
    Xiong, Taiping
    Cui, Gengshen
    Pan, Minghua
    Cheng, Nuo
    Wu, Xiangjie
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (30) : 75171 - 75194