Intelligent Fusion of Infrared and Visible Image Data Based on Convolutional Sparse Representation and Improved Pulse-Coupled Neural Network

被引:4
|
作者
Xia, Jingming [1 ]
Lu, Yi [1 ]
Tan, Ling [2 ]
Jiang, Ping [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Artificial Intelligence, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[3] Western Univ, London, ON N6A 3K7, Canada
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2021年 / 67卷 / 01期
基金
中国国家自然科学基金;
关键词
Image fusion; infrared image; visible light image; non-downsampling shear wave transform; improved PCNN; convolutional sparse representation;
D O I
10.32604/cmc.2021.013457
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-source information can be obtained through the fusion of infrared images and visible light images, which have the characteristics of complementary information. However, the existing acquisition methods of fusion images have disadvantages such as blurred edges, low contrast, and loss of details. Based on convolution sparse representation and improved pulse-coupled neural network this paper proposes an image fusion algorithm that decompose the source images into high-frequency and low-frequency subbands by non-subsampled Shearlet Transform (NSST). Furthermore, the low-frequency subbands were fused by convolutional sparse representation (CSR), and the high-frequency subbands were fused by an improved pulse coupled neural network (IPCNN) algorithm, which can effectively solve the problem of difficulty in setting parameters of the traditional PCNN algorithm, improving the performance of sparse representation with details injection. The result reveals that the proposed method in this paper has more advantages than the existing mainstream fusion algorithms in terms of visual effects and objective indicators.
引用
收藏
页码:613 / 624
页数:12
相关论文
共 50 条
  • [31] Infrared and Visible Image Fusion Based on Spatial Convolution Sparse representation
    Shao, Luling
    Wu, Jin
    Wu, Minghui
    2020 3RD INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SCIENCE AND APPLICATION TECHNOLOGY (CISAT) 2020, 2020, 1634
  • [32] Infrared and visible image fusion based on random projection and sparse representation
    Wang, Rui
    Du, Linfeng
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2014, 35 (05) : 1640 - 1652
  • [33] An Improved Pulse-Coupled Neural Network Model for Pansharpening
    Li, Xiaojun
    Yan, Haowen
    Xie, Weiying
    Kang, Lu
    Tian, Yi
    SENSORS, 2020, 20 (10)
  • [34] Image fusion based on convolution sparse representation and pulse coupled neural network in non-subsampled contourlet domain
    Li, Linguo
    Tan, Ling
    Li, Shujing
    Ye, Qing
    INTERNATIONAL JOURNAL OF EMBEDDED SYSTEMS, 2020, 12 (01) : 1 - 10
  • [35] The Multi-Focus-Image-Fusion Method Based on Convolutional Neural Network and Sparse Representation
    Wei, Bingzhe
    Feng, Xiangchu
    Wang, Kun
    Gao, Bian
    ENTROPY, 2021, 23 (07)
  • [36] A Visible and Passive Millimeter Wave Image Fusion Algorithm Based on Pulse-Coupled Neural Network in Tetrolet Domain for Early Risk Warning
    Li, Yuanjiang
    Ye, WeiYang
    Chen, Jian Fei
    Gong, Miao
    Zhang, Yousai
    Li, Feng
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2018, 2018
  • [37] Pulse coupled neural network based image fusion
    Li, M
    Cai, W
    Tan, Z
    ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 2, PROCEEDINGS, 2005, 3497 : 741 - 746
  • [38] DCFNet: Infrared and Visible Image Fusion Network Based on Discrete Wavelet Transform and Convolutional Neural Network
    Wu, Dan
    Wang, Yanzhi
    Wang, Haoran
    Wang, Fei
    Gao, Guowang
    SENSORS, 2024, 24 (13)
  • [39] Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network
    Feng, Bin
    Ai, Chengbo
    Zhang, Haofei
    ELECTRONICS, 2024, 13 (12)
  • [40] Transmission Line Equipment Infrared Diagnosis Using an Improved Pulse-Coupled Neural Network
    Tong, Jie
    Zhang, Xiangquan
    Cai, Changyu
    He, Zhouqiang
    Tan, Yuanpeng
    Chen, Zhao
    SUSTAINABILITY, 2023, 15 (01)