ACFNet: An adaptive cross-fusion network for infrared and visible image fusion

被引:0
|
作者
Chen, Xiaoxuan [1 ]
Xu, Shuwen [2 ]
Hu, Shaohai [1 ]
Ma, Xiaole [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp Sci & Technol, Visual Intellgence Int Cooperat Joint Lab MOE X, Beijing 100044, Peoples R China
[2] Res Inst TV & Electroacoust, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Object detection; Auto-encoder; Global features; Adaptive fusion method;
D O I
10.1016/j.patcog.2024.111098
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Considering the prospects for image fusion, it is necessary to guide the fusion to adapt to downstream vision tasks. In this paper, we propose an Adaptive Cross-Fusion Network (ACFNet) that utilizes an adaptive approach to fuse infrared and visible images, addressing cross-modal differences to enhance object detection performance. In ACFNet, a hierarchical cross-fusion module is designed to enrich the features at each level of the reconstructed images. In addition, a special adaptive gating selection module is proposed to realize feature fusion in an adaptive manner so as to obtain fused images without the interference of manual design. Extensive qualitative and quantitative experiments have demonstrated that ACFNet is superior to current state-of-the-art fusion methods and achieves excellent results in preserving target information and texture details. The fusion framework, when combined with the object detection framework, has the potential to significantly improve the precision of object detection in low-light conditions.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Infrared and Visible Image Fusion with a Generative Adversarial Network and a Residual Network
    Xu, Dongdong
    Wang, Yongcheng
    Xu, Shuyan
    Zhu, Kaiguang
    Zhang, Ning
    Zhang, Xin
    APPLIED SCIENCES-BASEL, 2020, 10 (02):
  • [32] Distillation-fusion-semantic unified driven network for infrared and visible image fusion
    Jiang, Yang
    Li, Jiawei
    Liu, Jinyuan
    Lei, Jia
    Li, Chen
    Zhou, Shihua
    Kasabov, Nikola K.
    INFRARED PHYSICS & TECHNOLOGY, 2024, 137
  • [33] DFPGAN: Dual fusion path generative adversarial network for infrared and visible image fusion
    Yi, Shi
    Li, Junjie
    Yuan, Xuesong
    INFRARED PHYSICS & TECHNOLOGY, 2021, 119
  • [34] Infrared and Visible Image Fusion via Multiscale Receptive Field Amplification Fusion Network
    Ji, Chuanming
    Zhou, Wujie
    Lei, Jingsheng
    Ye, Lv
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 493 - 497
  • [35] Infrared and visible image fusion based on global context network
    Li, Yonghong
    Shi, Yu
    Pu, Xingcheng
    Zhang, Suqiang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (05)
  • [36] Infrared and visible image fusion with supervised convolutional neural network
    An, Wen-Bo
    Wang, Hong-Mei
    OPTIK, 2020, 219
  • [37] A Dual-branch Network for Infrared and Visible Image Fusion
    Fu, Yu
    Wu, Xiao-Jun
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10675 - 10680
  • [38] Infrared and Visible Image Fusion with Convolutional Neural Network and Transformer
    Yang, Yang
    Ren, Zhennan
    Li, Beichen
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (16)
  • [39] MAFusion: Multiscale Attention Network for Infrared and Visible Image Fusion
    Li, Xiaoling
    Chen, Houjin
    Li, Yanfeng
    Peng, Yahui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [40] FusionGAN: A generative adversarial network for infrared and visible image fusion
    Ma, Jiayi
    Yu, Wei
    Liang, Pengwei
    Li, Chang
    Jiang, Junjun
    INFORMATION FUSION, 2019, 48 : 11 - 26