Intelligent Fusion of Infrared and Visible Image Data Based on Convolutional Sparse Representation and Improved Pulse-Coupled Neural Network

被引:4
|
作者
Xia, Jingming [1 ]
Lu, Yi [1 ]
Tan, Ling [2 ]
Jiang, Ping [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Artificial Intelligence, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[3] Western Univ, London, ON N6A 3K7, Canada
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2021年 / 67卷 / 01期
基金
中国国家自然科学基金;
关键词
Image fusion; infrared image; visible light image; non-downsampling shear wave transform; improved PCNN; convolutional sparse representation;
D O I
10.32604/cmc.2021.013457
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-source information can be obtained through the fusion of infrared images and visible light images, which have the characteristics of complementary information. However, the existing acquisition methods of fusion images have disadvantages such as blurred edges, low contrast, and loss of details. Based on convolution sparse representation and improved pulse-coupled neural network this paper proposes an image fusion algorithm that decompose the source images into high-frequency and low-frequency subbands by non-subsampled Shearlet Transform (NSST). Furthermore, the low-frequency subbands were fused by convolutional sparse representation (CSR), and the high-frequency subbands were fused by an improved pulse coupled neural network (IPCNN) algorithm, which can effectively solve the problem of difficulty in setting parameters of the traditional PCNN algorithm, improving the performance of sparse representation with details injection. The result reveals that the proposed method in this paper has more advantages than the existing mainstream fusion algorithms in terms of visual effects and objective indicators.
引用
收藏
页码:613 / 624
页数:12
相关论文
共 50 条
  • [1] Research of Multimodal Medical Image Fusion Based on Parameter-Adaptive Pulse-Coupled Neural Network and Convolutional Sparse Representation
    Xia, Jingming
    Lu, Yi
    Tan, Ling
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2020, 2020
  • [2] Infrared and Visible Image Fusion Combining Pulse-Coupled Neural Network and Guided Filtering
    Zhou XiaoLing
    Jiang Zetao
    ACTA OPTICA SINICA, 2019, 39 (11)
  • [3] Review of Image Fusion Based on Pulse-Coupled Neural Network
    Zhaobin Wang
    Shuai Wang
    Ying Zhu
    Yide Ma
    Archives of Computational Methods in Engineering, 2016, 23 : 659 - 671
  • [4] Review of Image Fusion Based on Pulse-Coupled Neural Network
    Wang, Zhaobin
    Wang, Shuai
    Zhu, Ying
    Ma, Yide
    ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2016, 23 (04) : 659 - 671
  • [5] Improved Fusion Algorithm for Infrared and Visible Images Based on Image Enhancement and Convolutional Sparse Representation
    Zhu, Rong
    Zheng, Wan-bo
    Wang, Yao
    Tan, Chun-lin
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2025, 45 (02) : 558 - 568
  • [6] A Novel Image Fusion Framework Based on Sparse Representation and Pulse Coupled Neural Network
    Yin, Li
    Zheng, Mingyao
    Qi, Guanqiu
    Zhu, Zhiqin
    Jin, Fu
    Sim, Jaesung
    IEEE ACCESS, 2019, 7 : 98290 - 98305
  • [7] Technique for image fusion based on nonsubsampled shearlet transform and improved pulse-coupled neural network
    Kong, Weiwei
    Liu, Jianping
    OPTICAL ENGINEERING, 2013, 52 (01)
  • [8] Infrared and visible image fusion based on convolutional sparse representation and guided filtering
    Zhu, Yansong
    Lu, Yixiang
    Gao, Qingwei
    Sun, Dong
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (04)
  • [9] Infrared and visible image fusion via joint convolutional sparse representation
    Wu, Minghui
    Ma, Yong
    Fan, Fan
    Mei, Xiaoguang
    Huang, Jun
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2020, 37 (07) : 1105 - 1115
  • [10] Infrared and Visible Image Fusion Using NSCT and Convolutional Sparse Representation
    Zhang, Chengfang
    Yue, Zhen
    Yi, Liangzhong
    Jin, Xin
    Yan, Dan
    Yang, Xingchun
    IMAGE AND GRAPHICS, ICIG 2019, PT I, 2019, 11901 : 393 - 405