Image fusion;
Object detection;
Auto-encoder;
Global features;
Adaptive fusion method;
D O I:
10.1016/j.patcog.2024.111098
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
Considering the prospects for image fusion, it is necessary to guide the fusion to adapt to downstream vision tasks. In this paper, we propose an Adaptive Cross-Fusion Network (ACFNet) that utilizes an adaptive approach to fuse infrared and visible images, addressing cross-modal differences to enhance object detection performance. In ACFNet, a hierarchical cross-fusion module is designed to enrich the features at each level of the reconstructed images. In addition, a special adaptive gating selection module is proposed to realize feature fusion in an adaptive manner so as to obtain fused images without the interference of manual design. Extensive qualitative and quantitative experiments have demonstrated that ACFNet is superior to current state-of-the-art fusion methods and achieves excellent results in preserving target information and texture details. The fusion framework, when combined with the object detection framework, has the potential to significantly improve the precision of object detection in low-light conditions.
机构:
Jiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
HorizonFlow Lab, Wuxi, Peoples R China
Wuxi Univ, Sch Elect & Informat Engn, OptiX Lab, Wuxi, Peoples R China
Wuxi Univ, Jiangsu Prov Engn Res Ctr Integrated Circuit Relia, Wuxi, Peoples R ChinaJiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
Gu, Yuanjie
Xiao, Zhibo
论文数: 0引用数: 0
h-index: 0
机构:
Jiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
HorizonFlow Lab, Wuxi, Peoples R China
Wuxi Univ, Sch Elect & Informat Engn, OptiX Lab, Wuxi, Peoples R China
Wuxi Univ, Jiangsu Prov Engn Res Ctr Integrated Circuit Relia, Wuxi, Peoples R ChinaJiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
Xiao, Zhibo
Guan, Yinghan
论文数: 0引用数: 0
h-index: 0
机构:
HorizonFlow Lab, Wuxi, Peoples R China
Wuxi Univ, Sch Elect & Informat Engn, OptiX Lab, Wuxi, Peoples R China
Three Gorges Univ, Sch Elect & Informat Engn, Chongqing, Peoples R ChinaJiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
Guan, Yinghan
Dai, Haoran
论文数: 0引用数: 0
h-index: 0
机构:
HorizonFlow Lab, Wuxi, Peoples R China
Boston Univ, Metropolitan Coll, Dept Comp Sci, Boston, MA USAJiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
Dai, Haoran
Liu, Cheng
论文数: 0引用数: 0
h-index: 0
机构:
Jiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
Chinese Acad Sci, Shanghai Inst Opt & Fine Mech, Shanghai, Peoples R ChinaJiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
Liu, Cheng
Xue, Liang
论文数: 0引用数: 0
h-index: 0
机构:
Shanghai Univ Elect Power, Coll Elect & Informat Engn, Shanghai, Peoples R ChinaJiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China
Xue, Liang
Wang, Shouyu
论文数: 0引用数: 0
h-index: 0
机构:
Wuxi Univ, Sch Elect & Informat Engn, OptiX Lab, Wuxi, Peoples R China
Wuxi Univ, Jiangsu Prov Engn Res Ctr Integrated Circuit Relia, Wuxi, Peoples R China
Single Mol Nanometry Lab, Nanjing, Peoples R ChinaJiangnan Univ, Sch Sci, Computat Opt Lab, Wuxi, Peoples R China