ACFNet: An adaptive cross-fusion network for infrared and visible image fusion

被引:0
|
作者
Chen, Xiaoxuan [1 ]
Xu, Shuwen [2 ]
Hu, Shaohai [1 ]
Ma, Xiaole [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp Sci & Technol, Visual Intellgence Int Cooperat Joint Lab MOE X, Beijing 100044, Peoples R China
[2] Res Inst TV & Electroacoust, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Object detection; Auto-encoder; Global features; Adaptive fusion method;
D O I
10.1016/j.patcog.2024.111098
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Considering the prospects for image fusion, it is necessary to guide the fusion to adapt to downstream vision tasks. In this paper, we propose an Adaptive Cross-Fusion Network (ACFNet) that utilizes an adaptive approach to fuse infrared and visible images, addressing cross-modal differences to enhance object detection performance. In ACFNet, a hierarchical cross-fusion module is designed to enrich the features at each level of the reconstructed images. In addition, a special adaptive gating selection module is proposed to realize feature fusion in an adaptive manner so as to obtain fused images without the interference of manual design. Extensive qualitative and quantitative experiments have demonstrated that ACFNet is superior to current state-of-the-art fusion methods and achieves excellent results in preserving target information and texture details. The fusion framework, when combined with the object detection framework, has the potential to significantly improve the precision of object detection in low-light conditions.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Multiscale cross-fusion network for hyperspectral image classification
    Pan, Haizhu
    Zhu, Yuexia
    Ge, Haimiao
    Liu, Moqi
    Shi, Cuiping
    EGYPTIAN JOURNAL OF REMOTE SENSING AND SPACE SCIENCES, 2023, 26 (03): : 839 - 850
  • [2] Multi-Level Adaptive Attention Fusion Network for Infrared and Visible Image Fusion
    Hu, Ziming
    Kong, Quan
    Liao, Qing
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 366 - 370
  • [3] MSFNet: MultiStage Fusion Network for infrared and visible image fusion
    Wang, Chenwu
    Wu, Junsheng
    Zhu, Zhixiang
    Chen, Hao
    NEUROCOMPUTING, 2022, 507 : 26 - 39
  • [4] CCFNet: Collaborative Cross-Fusion Network for Medical Image Segmentation
    Chen, Jialu
    Yuan, Baohua
    ALGORITHMS, 2024, 17 (04)
  • [5] HYPERSPECTRAL IMAGE DENOISING BASED ON PARALLEL CROSS-FUSION NETWORK
    Gong, Zhuoran
    Gao, Feng
    Dong, Junyu
    Qi, Lin
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1528 - 1531
  • [6] A Dual Cross Attention Transformer Network for Infrared and Visible Image Fusion
    Zhou, Zhuozhi
    Lan, Jinhui
    2024 7TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA, ICAIBD 2024, 2024, : 494 - 499
  • [7] A Two-Branch Fusion Network for Infrared and Visible Image Fusion
    Zhang, Weihao
    Li, Zhilin
    Li, Bin
    Zhang, Mingliang
    PATTERN RECOGNITION AND COMPUTER VISION, PT IX, PRCV 2024, 2025, 15039 : 42 - 55
  • [8] ACFNet: An Adaptive Context Fusion Network for Skin Lesion Segmentation
    Sun, Jingtong
    Xi, Wei
    Bai, Gairui
    Liu, Xinhui
    Yu, Fan
    Zhang, Chao
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [9] DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion
    Wu, Dan
    Han, Mina
    Yang, Yang
    Zhao, Shan
    Rao, Yujing
    Li, Hao
    Lin, Xing
    Zhou, Chengjiang
    Bai, Haicheng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [10] Pairwise Guided Multilayer Cross-Fusion Network for Bird Image Recognition
    Lei, Jingsheng
    Jin, Yao
    Huang, Liya
    Ji, Yuan
    Yang, Shengying
    ELECTRONICS, 2023, 12 (18)