ACFNet: An adaptive cross-fusion network for infrared and visible image fusion

被引:0
|
作者
Chen, Xiaoxuan [1 ]
Xu, Shuwen [2 ]
Hu, Shaohai [1 ]
Ma, Xiaole [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp Sci & Technol, Visual Intellgence Int Cooperat Joint Lab MOE X, Beijing 100044, Peoples R China
[2] Res Inst TV & Electroacoust, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Object detection; Auto-encoder; Global features; Adaptive fusion method;
D O I
10.1016/j.patcog.2024.111098
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Considering the prospects for image fusion, it is necessary to guide the fusion to adapt to downstream vision tasks. In this paper, we propose an Adaptive Cross-Fusion Network (ACFNet) that utilizes an adaptive approach to fuse infrared and visible images, addressing cross-modal differences to enhance object detection performance. In ACFNet, a hierarchical cross-fusion module is designed to enrich the features at each level of the reconstructed images. In addition, a special adaptive gating selection module is proposed to realize feature fusion in an adaptive manner so as to obtain fused images without the interference of manual design. Extensive qualitative and quantitative experiments have demonstrated that ACFNet is superior to current state-of-the-art fusion methods and achieves excellent results in preserving target information and texture details. The fusion framework, when combined with the object detection framework, has the potential to significantly improve the precision of object detection in low-light conditions.
引用
收藏
页数:14
相关论文
共 50 条
  • [11] Physics driven deep Retinex fusion for adaptive infrared and visible image fusion
    Gu, Yuanjie
    Xiao, Zhibo
    Guan, Yinghan
    Dai, Haoran
    Liu, Cheng
    Xue, Liang
    Wang, Shouyu
    OPTICAL ENGINEERING, 2023, 62 (08) : 83101
  • [12] MCnet: Multiscale visible image and infrared image fusion network
    Sun, Le
    Li, Yuhang
    Zheng, Min
    Zhong, Zhaoyi
    Zhang, Yanchun
    SIGNAL PROCESSING, 2023, 208
  • [13] Infrared and Visible Image Fusion Based on Mask and Cross-Dynamic Fusion
    Fu, Qiang
    Fu, Hanxiang
    Wu, Yuezhou
    ELECTRONICS, 2023, 12 (20)
  • [14] An Efficient Network Model for Visible and Infrared Image Fusion
    Pan, Zhu
    Ouyang, Wanqi
    IEEE ACCESS, 2023, 11 : 86413 - 86430
  • [15] Multigrained Attention Network for Infrared and Visible Image Fusion
    Li, Jing
    Huo, Hongtao
    Li, Chang
    Wang, Renhua
    Sui, Chenhong
    Liu, Zhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [16] CFNet: An infrared and visible image compression fusion network
    Xing, Mengliang
    Liu, Gang
    Tang, Haojie
    Qian, Yao
    Zhang, Jun
    PATTERN RECOGNITION, 2024, 156
  • [17] SimpliFusion: a simplified infrared and visible image fusion network
    Liu, Yong
    Li, Xingyuan
    Liu, Yong
    Zhong, Wei
    VISUAL COMPUTER, 2025, 41 (02): : 1335 - 1350
  • [18] Infrared and Visible Image Fusion via Decoupling Network
    Wang, Xue
    Guan, Zheng
    Yu, Shishuang
    Cao, Jinde
    Li, Ya
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [19] PFCFuse: A Poolformer and CNN Fusion Network for Infrared-Visible Image Fusion
    Hu, Xinyu
    Liu, Yang
    Yang, Feng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [20] Laplacian Pyramid Fusion Network With Hierarchical Guidance for Infrared and Visible Image Fusion
    Yao, Jiaxin
    Zhao, Yongqiang
    Bu, Yuanyang
    Kong, Seong G.
    Chan, Jonathan Cheung-Wai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4630 - 4644