Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

被引:2
|
作者
Feng, Bin [1 ]
Ai, Chengbo [1 ]
Zhang, Haofei [2 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] 208 Res Inst China Ordnance Ind, Beijing 102202, Peoples R China
关键词
pulse coupled neural network; infrared and visible light images; image fusion; non-subsampled shearlet transform; PERFORMANCE; PCNN;
D O I
10.3390/electronics13122337
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The pulse-coupled neural network (PCNN), due to its effectiveness in simulating the mammalian visual system to perceive and understand visual information, has been widely applied in the fields of image segmentation and image fusion. To address the issues of low contrast and the loss of detail information in infrared and visible light image fusion, this paper proposes a novel image fusion method based on an improved adaptive dual-channel PCNN model in the non-subsampled shearlet transform (NSST) domain. Firstly, NSST is used to decompose the infrared and visible light images into a series of high-pass sub-bands and a low-pass sub-band, respectively. Next, the PCNN models are stimulated using the weighted sum of the eight-neighborhood Laplacian of the high-pass sub-bands and the energy activity of the low-pass sub-band. The high-pass sub-bands are fused using local structural information as the basis for the linking strength for the PCNN, while the low-pass sub-band is fused using a linking strength based on multiscale morphological gradients. Finally, the fused high-pass and low-pass sub-bands are reconstructed to obtain the fused image. Comparative experiments demonstrate that, subjectively, this method effectively enhances the contrast of scenes and targets while preserving the detail information of the source images. Compared to the best mean values of the objective evaluation metrics of the compared methods, the proposed method shows improvements of 2.35%, 3.49%, and 11.60% in information entropy, mutual information, and standard deviation, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Feature-Based Fusion of Dual Band Infrared Image Using Multiple Pulse Coupled Neural Network
    Yuqing He
    Shuaiying Wei
    Tao Yang
    Weiqi Jin
    Mingqi Liu
    Xiangyang Zhai
    JournalofBeijingInstituteofTechnology, 2019, 28 (01) : 129 - 136
  • [32] A Remote Sensing Image Fusion Method Combining Low-Level Visual Features and Parameter-Adaptive Dual-Channel Pulse-Coupled Neural Network
    Hou, Zhaoyang
    Lv, Kaiyun
    Gong, Xunqiang
    Wan, Yuting
    REMOTE SENSING, 2023, 15 (02)
  • [33] Image fusion scheme based on modified dual pulse coupled neural network
    El-taweel, Ghada Sami
    Helmy, Ashraf Khaled
    IET IMAGE PROCESSING, 2013, 7 (05) : 407 - 414
  • [34] DUAL-CHANNEL CONVOLUTIONAL NEURAL NETWORK FOR POLARIMETRIC SAR IMAGES CLASSIFICATION
    Hua, Wenqiang
    Wang, Shuang
    Xie, Wen
    Guo, Yanhe
    Jin, Xiaomin
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3201 - 3204
  • [35] Dual-Channel Speech Enhancement Using Neural Network Adaptive Beamforming
    Jiang, Tao
    Liu, Hongqing
    Shuai, Chenhao
    Wang, Mingtian
    Zhou, Yi
    Gan, Lu
    COMMUNICATIONS AND NETWORKING (CHINACOM 2021), 2022, : 497 - 506
  • [36] Infrared and Visible Image Fusion Based on Improved Dual Path Generation Adversarial Network
    Yang, Shen
    Tian, Lifan
    Liang, Jiaming
    Huang, Zefeng
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 3012 - 3021
  • [37] A Dual Branch Edge Convolution Fusion Network for Infrared and Visible Images
    Zhang, Hongde
    Feng, Xin
    Yang, Jieming
    Qiu, Guohang
    ACTA PHOTONICA SINICA, 2024, 53 (08)
  • [38] Infrared and visible image fusion based on multi-channel convolutional neural network
    Wang, Hongmei
    An, Wenbo
    Li, Lin
    Li, Chenkai
    Zhou, Daming
    IET IMAGE PROCESSING, 2022, 16 (06) : 1575 - 1584
  • [39] FefDM-Transformer: Dual-channel multi-stage Transformer-based encoding and fusion mode for infrared-visible images
    Li, Junwu
    Wang, Yaomin
    Ning, Xin
    He, Wenguang
    Cai, Weiwei
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 277
  • [40] An Improved Fusion Method of Infrared and Visible Images Based on FusionGAN
    Yao, Zhiqiang
    Guo, Huinan
    Ren, Long
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878