Image Compressed Sensing Using Non-Local Neural Network

被引:45
|
作者
Cui, Wenxue
Liu, Shaohui
Jiang, Feng
Zhao, Debin [1 ]
机构
[1] Harbin Inst Technol, Dept Comp Sci & Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Neural networks; Reconstruction algorithms; Training; Noise reduction; Iterative algorithms; Current measurement; Convolutional neural networks (CNNs); image compressed sensing; non-local neural network; non-local self-similarity prior; THRESHOLDING ALGORITHM; RECONSTRUCTION; REGULARIZATION; FRAMEWORK;
D O I
10.1109/TMM.2021.3132489
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep network-based image Compressed Sensing (CS) has attracted much attention in recent years. However, the existing deep network-based CS schemes either reconstruct the target image in a block-by-block manner that leads to serious block artifacts or train the deep network as a black box that brings about limited insights of image prior knowledge. In this paper, a novel image CS framework using non-local neural network (NL-CSNet) is proposed, which utilizes the non-local self-similarity priors with deep network to improve the reconstruction quality. In the proposed NL-CSNet, two non-local subnetworks are constructed for utilizing the non-local self-similarity priors in the measurement domain and the multi-scale feature domain respectively. Specifically, in the subnetwork of measurement domain, the long-distance dependencies between the measurements of different image blocks are established for better initial reconstruction. Analogically, in the subnetwork of multi-scale feature domain, the affinities between the dense feature representations are explored in the multi-scale space for deep reconstruction. Furthermore, a novel loss function is developed to enhance the coupling between the non-local representations, which also enables an end-to-end training of NL-CSNet. Extensive experiments manifest that NL-CSNet outperforms existing state-of-the-art CS methods, while maintaining fast computational speed.
引用
收藏
页码:816 / 830
页数:15
相关论文
共 50 条
  • [31] LIGHTWEIGHT NON-LOCAL NETWORK FOR IMAGE SUPER-RESOLUTION
    Wang, Risheng
    Lei, Tao
    Zhou, Wenzheng
    Wang, Qi
    Meng, Hongying
    Nandi, Asoke K.
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1625 - 1629
  • [32] A Non-local Graph Neural Network for Identification of Essential Proteins
    Zhang, Houwang
    Feng, Zhenan
    Wu, Chong
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [33] A Convolutional Neural Network with Non-Local Module for Speech Enhancement
    Li, Xiaoqi
    Li, Yaxing
    Li, Meng
    Xu, Shan
    Dong, Yuanjie
    Sun, Xinrong
    Xiong, Shengwu
    INTERSPEECH 2019, 2019, : 1796 - 1800
  • [34] Liver Segmentation in CT Images Using a Non-Local Fully Convolutional Neural Network
    Chen, Lei
    Song, Hong
    Li, Qiang
    Cui, Yutao
    Yang, Jian
    Hu, Xiaohua Tony
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 639 - 642
  • [35] Accurate Extraction of Brillouin Frequency Shift using Single Deep Neural Network in BOTDA Sensing System with Non-Local Effect
    Qian, Yuhao
    Yang, Guijiang
    Zeng, Keyan
    Wang, Liang
    Tang, Ming
    Liu, Deming
    2023 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION, OFC, 2023,
  • [36] Non-local image interpolation
    Luong, Hiep Quang
    Ledda, Alessandro
    Philips, Wilfried
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 693 - +
  • [37] Multispectral Remote Sensing Image Denoising Based on Non-Local Means
    Liu Peng
    Liu Ding-sheng
    Li Guo-qing
    Liu Zhi-wen
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2011, 31 (11) : 2991 - 2995
  • [38] Non-Local Image Dehazing
    Berman, Dana
    Treibitz, Tali
    Avidan, Shai
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1674 - 1682
  • [39] IMAGE DENOISING USING NON-LOCAL FUZZY MEANS
    Lan, Rushi
    Zhou, Yicong
    Tang, Yuan Yan
    Chen, C. L. Philip
    2015 IEEE CHINA SUMMIT & INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING, 2015, : 196 - 200
  • [40] Non-local Neural Networks
    Wang, Xiaolong
    Girshick, Ross
    Gupta, Abhinav
    He, Kaiming
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7794 - 7803