Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

被引:2
|
作者
Feng, Bin [1 ]
Ai, Chengbo [1 ]
Zhang, Haofei [2 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] 208 Res Inst China Ordnance Ind, Beijing 102202, Peoples R China
关键词
pulse coupled neural network; infrared and visible light images; image fusion; non-subsampled shearlet transform; PERFORMANCE; PCNN;
D O I
10.3390/electronics13122337
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The pulse-coupled neural network (PCNN), due to its effectiveness in simulating the mammalian visual system to perceive and understand visual information, has been widely applied in the fields of image segmentation and image fusion. To address the issues of low contrast and the loss of detail information in infrared and visible light image fusion, this paper proposes a novel image fusion method based on an improved adaptive dual-channel PCNN model in the non-subsampled shearlet transform (NSST) domain. Firstly, NSST is used to decompose the infrared and visible light images into a series of high-pass sub-bands and a low-pass sub-band, respectively. Next, the PCNN models are stimulated using the weighted sum of the eight-neighborhood Laplacian of the high-pass sub-bands and the energy activity of the low-pass sub-band. The high-pass sub-bands are fused using local structural information as the basis for the linking strength for the PCNN, while the low-pass sub-band is fused using a linking strength based on multiscale morphological gradients. Finally, the fused high-pass and low-pass sub-bands are reconstructed to obtain the fused image. Comparative experiments demonstrate that, subjectively, this method effectively enhances the contrast of scenes and targets while preserving the detail information of the source images. Compared to the best mean values of the objective evaluation metrics of the compared methods, the proposed method shows improvements of 2.35%, 3.49%, and 11.60% in information entropy, mutual information, and standard deviation, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] A novel image fusion method using self-adaptive dual-channel pulse coupled neural networks based on PSO evolutionary learning
    Wu, X.-J. (xiaojun_wu_jnu@163.com), 1600, Chinese Institute of Electronics (42):
  • [22] Compound Jamming Recognition Based on a Dual-Channel Neural Network and Feature Fusion
    Chen, Hao
    Chen, Hui
    Lei, Zhenshuo
    Zhang, Liang
    Li, Binbin
    Zhang, Jiajia
    Wang, Yongliang
    REMOTE SENSING, 2024, 16 (08)
  • [23] Remote Sensing Image Reconstruction Method Based on Parameter Adaptive Dual-Channel Pulse-Coupled Neural Network to Optimize Multiscale Decomposition
    Hu, Pengcheng
    Tang, Shihua
    Zhang, Yan
    Song, Xiaohui
    Sun, Mengbo
    IEEE ACCESS, 2023, 11 : 78084 - 78103
  • [24] Adjacent Feature Combination Based Adaptive Fusion Network for Infrared and Visible Images
    Xu S.
    Chen X.
    Luo J.
    Cheng X.
    Xiao N.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2022, 35 (12): : 1089 - 1100
  • [25] SeACPFusion: An Adaptive Fusion Network for Infrared and Visible Images based on brightness perception
    Li, Wangjie
    Lv, Xiaoyi
    Zhou, Yaoyong
    Wang, Yunling
    Li, Min
    INFRARED PHYSICS & TECHNOLOGY, 2024, 142
  • [26] Dual Channel Quantum Pulse Coupled Neural Network
    Wang Z.
    Xu M.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2023, 52 (03): : 331 - 340
  • [27] Infrared and Visible Image Fusion Based on Dual Channel Residual Dense Network
    Feng Xin
    Yang Jieming
    Zhang Hongde
    Qiu Guohang
    ACTA PHOTONICA SINICA, 2023, 52 (11)
  • [28] INFRARED AND VISIBLE IMAGE FUSION BASED ON OBJECT EXTRACTION AND ADAPTIVE PULSE COUPLED NEURAL NETWORK VIA NON-SUBSAMPLED SHEARLET TRANSFORM
    Sun Wei
    Hu Shaohai
    Liu Shuaiqi
    Sun Yuchao
    2014 12TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2014, : 946 - 951
  • [29] Infrared and Visible Image Fusion Combining Pulse-Coupled Neural Network and Guided Filtering
    Zhou XiaoLing
    Jiang Zetao
    ACTA OPTICA SINICA, 2019, 39 (11)
  • [30] Feature-Based Fusion of Dual Band Infrared Image Using Multiple Pulse Coupled Neural Network
    He Y.
    Wei S.
    Yang T.
    Jin W.
    Liu M.
    Zhai X.
    Journal of Beijing Institute of Technology (English Edition), 2019, 28 (01): : 129 - 136