Total variation and block-matching 3D filtering-based image reconstruction for single-shot compressed ultrafast photography

被引:15
|
作者
Yao, Jiali [1 ]
Qi, Dalong [1 ]
Yao, Yunhua [1 ]
Cao, Fengyan [1 ]
He, Yilin [1 ]
Ding, Pengpeng [1 ]
Jin, Chengzhi [1 ]
Jia, Tianqing [1 ]
Liang, Jinyang [2 ]
Deng, Lianzhong [1 ]
Sun, Zhenrong [1 ]
Zhang, Shian [1 ,3 ,4 ]
机构
[1] East China Normal Univ, Sch Phys & Elect Sci, State Key Lab Precis Spect, Shanghai 200062, Peoples R China
[2] Inst Natl Rech Sci, Ctr Energie Mat Telecommun, Lab Appl Computat Imaging, Varennes, PQ J3X 1S2, Canada
[3] Shanxi Univ, Collaborat Innovat Ctr Extreme Opt, Taiyuan 030006, Peoples R China
[4] Shandong Normal Univ, Collaborat Innovat Ctr Light Manipulat & Applicat, Jinan 250358, Peoples R China
基金
中国国家自然科学基金;
关键词
Optical imaging; Computational imaging; Compressed sensing; Image denoising;
D O I
10.1016/j.optlaseng.2020.106475
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Compressed ultrafast photography (CUP), as the fastest receive-only ultrafast imaging technology by combining steak imaging and compressed sensing (CS), has shown to be a powerful tool to measure ultrafast dynamic scenes. Through a reconstruction algorithm based on CS, CUP can capture the three-dimensional image information of non-repetitive transient events with a single exposure. However, it still suffers from poor image reconstruction quality on account of the super-high data compression ratio induced by the undersampling strategy. Here, we propose a total variation (TV) combined with block matching and 3D filtering (BM3D) reconstruction algorithm to improve the image quality of CUP, which is named as the TV-BM3D algorithm. The proposed algorithm can simultaneously exploit gradient sparsity and non-local similarity for image reconstruction by incorporating TV and BM3D denoisers. Both the numerical simulations and experimental results show that, compared with the two conventional two-step iterative shrinkage/thresholding and augmented Lagrangian algorithms in CUP, the TV-BM3D algorithm can not only improve the image reconstruction quality, but also strengthen the noise immunity of this technique. It is prospected that these improvements in image reconstruction will further promote the practical applications of CUP in capturing complex physical and biological dynamics.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] IMAGE-BASED 3D MESH DENOISING THROUGH A BLOCK MATCHING 3D CONVOLUTIONAL NEURAL NETWORK FILTERING APPROACH
    Arvanitis, Gerasimos
    Lalos, Aris S.
    Moustakas, Konstantinos
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [42] Single-shot 3D shape reconstruction for complex surface objects with colour texture based on deep learning
    Xu, Min
    Zhang, Yu
    Wang, Nan
    Luo, Lin
    Peng, Jianping
    JOURNAL OF MODERN OPTICS, 2022, 69 (16) : 941 - 956
  • [43] Image Denoising with Signal Dependent Noise Using Block Matching and 3D Filtering
    Chen, Guangyi
    Xie, Wenfang
    Dai, Shuling
    ADVANCES IN NEURAL NETWORKS - ISNN 2014, 2014, 8866 : 423 - 430
  • [44] LOSSLESS IMAGE COMPRESSION USING CAUSAL BLOCK MATCHING AND 3D COLLABORATIVE FILTERING
    Crandall, Robert
    Bilgin, Ali
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 5636 - 5640
  • [45] Single-shot 3D imaging with point cloud projection based on metadevice
    Jing, Xiaoli
    Zhao, Ruizhe
    Li, Xin
    Jiang, Qiang
    Li, Chengzhi
    Geng, Guangzhou
    Li, Junjie
    Wang, Yongtian
    Huang, Lingling
    NATURE COMMUNICATIONS, 2022, 13 (01)
  • [46] Single-shot 3D imaging with point cloud projection based on metadevice
    Xiaoli Jing
    Ruizhe Zhao
    Xin Li
    Qiang Jiang
    Chengzhi Li
    Guangzhou Geng
    Junjie Li
    Yongtian Wang
    Lingling Huang
    Nature Communications, 13
  • [47] Single-shot 3D shape reconstruction using multi-wavelength pattern projection
    Zhang, Chen
    Brahm, Anika
    Breitbarth, Andreas
    Rosenberger, Maik
    Notni, Gunther
    DIMENSIONAL OPTICAL METROLOGY AND INSPECTION FOR PRACTICAL APPLICATIONS VIII, 2019, 10991
  • [48] A Total Variation Based Reconstruction Algorithm for 3D Ultrasound
    Afonso, Manya V.
    Sanches, Joao M. R.
    PATTERN RECOGNITION AND IMAGE ANALYSIS, IBPRIA 2013, 2013, 7887 : 149 - 156
  • [49] Research on 3D Reconstruction Based on a Single Image
    Yu Yong-yan
    Wang Zhi-jian
    PROGRESS IN MEASUREMENT AND TESTING, PTS 1 AND 2, 2010, 108-111 : 3 - 10
  • [50] The Research of 3D Reconstruction Based on Single Image
    Zhang, Yong
    Zhang, Li
    PROCEEDINGS OF THE 2ND INTERNATIONAL SYMPOSIUM ON COMPUTER, COMMUNICATION, CONTROL AND AUTOMATION, 2013, 68 : 59 - 62