ACFNet: An adaptive cross-fusion network for infrared and visible image fusion

被引:0
|
作者
Chen, Xiaoxuan [1 ]
Xu, Shuwen [2 ]
Hu, Shaohai [1 ]
Ma, Xiaole [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp Sci & Technol, Visual Intellgence Int Cooperat Joint Lab MOE X, Beijing 100044, Peoples R China
[2] Res Inst TV & Electroacoust, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Object detection; Auto-encoder; Global features; Adaptive fusion method;
D O I
10.1016/j.patcog.2024.111098
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Considering the prospects for image fusion, it is necessary to guide the fusion to adapt to downstream vision tasks. In this paper, we propose an Adaptive Cross-Fusion Network (ACFNet) that utilizes an adaptive approach to fuse infrared and visible images, addressing cross-modal differences to enhance object detection performance. In ACFNet, a hierarchical cross-fusion module is designed to enrich the features at each level of the reconstructed images. In addition, a special adaptive gating selection module is proposed to realize feature fusion in an adaptive manner so as to obtain fused images without the interference of manual design. Extensive qualitative and quantitative experiments have demonstrated that ACFNet is superior to current state-of-the-art fusion methods and achieves excellent results in preserving target information and texture details. The fusion framework, when combined with the object detection framework, has the potential to significantly improve the precision of object detection in low-light conditions.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] MDC-FusFormer: Multiscale Deep Cross-Fusion Transformer Network for Hyperspectral and Multispectral Image Fusion
    Sun, Le
    Zhou, Jianxiao
    Ye, Qiaolin
    Wu, Zebin
    Chen, Qiao
    Xu, Zhongqi
    Fu, Liyong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [22] Enlighten Fusion Multiscale Network for Infrared and Visible Image Fusion in Dark Environments
    Wang, Haozhe
    Shu, Chang
    Li, Xiaofeng
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1167 - 1171
  • [23] ASIFusion: An Adaptive Saliency Injection-Based Infrared and Visible Image Fusion Network
    Liu, Ziyi
    Yang, You
    Wu, Kejun
    Liu, Qiong
    Xu, Xinghua
    Ma, Xiaoxuan
    Tang, Jiang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (09)
  • [24] Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion
    Wang, Lei
    Hu, Ziming
    Kong, Quan
    Qi, Qian
    Liao, Qing
    ENTROPY, 2023, 25 (03)
  • [25] Visible and Infrared Image Adaptive Fusion Based on Bilateral Filters
    Tang W.
    Jia F.
    Wang X.
    Binggong Xuebao/Acta Armamentarii, 2022, 43 (11): : 2836 - 2845
  • [26] Fusion of Visible and Infrared Image Using Adaptive Tetrolet Transform
    Liu, Kaifeng
    Yuan, Baohong
    Zhang, Dexiang
    Zhang, Jingjing
    PROCEEDINGS OF THE 2015 4TH INTERNATIONAL CONFERENCE ON COMPUTER, MECHATRONICS, CONTROL AND ELECTRONIC ENGINEERING (ICCMCEE 2015), 2015, 37 : 814 - 818
  • [27] MACCNet: Multiscale Attention and Cross- Convolutional Network for Infrared and Visible Image Fusion
    Yang, Yong
    Zhou, Na
    Wan, Weiguo
    Huang, Shuying
    IEEE SENSORS JOURNAL, 2024, 24 (10) : 16587 - 16600
  • [28] CCAFusion: Cross-Modal Coordinate Attention Network for Infrared and Visible Image Fusion
    Li, Xiaoling
    Li, Yanfeng
    Chen, Houjin
    Peng, Yahui
    Pan, Pan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 866 - 881
  • [29] CFET: A Cross-Fusion Enhanced Transformer for Visible-infrared person re-identification
    Guo, Jiangtao
    Du, Haishun
    Hao, Xinxin
    Zhang, Minghao
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 271
  • [30] Cross-Modal Transformers for Infrared and Visible Image Fusion
    Park, Seonghyun
    Vien, An Gia
    Lee, Chul
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 770 - 785