Image inpainting algorithm based on tensor decomposition and weighted nuclear norm

被引:4
|
作者
Liu, Xuya [1 ]
Hao, Caiyan [2 ]
Su, Zezhao [3 ]
Qi, Zerong [4 ]
Fu, Shujun [5 ]
Li, Yuliang [6 ]
Han, Hongbin [7 ,8 ]
机构
[1] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Qingdao Hiimage Technol Co Ltd, Qingdao 266000, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Shantou 515063, Peoples R China
[4] Shandong Chengshi Elect Technol Ltd Co, Jinan 250031, Peoples R China
[5] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[6] Shandong Univ, Dept Intervent Med, Hosp 2, Jinan 250100, Peoples R China
[7] Peking Univ Third Hosp, Dept Radiol, Beijing 100089, Peoples R China
[8] Beijing Key Lab Magnet Resonance Imaging Equipmen, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Low-rank approximation; Nonlocal similarity; Tensor completion; Tensor ring decomposition; MATRIX COMPLETION;
D O I
10.1007/s11042-022-12635-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a damaged image, recovering an image with missing entire rows or columns is a challenging problem arising in many real applications, such as digital image inpainting. For this kind of information missing situation, the diffusion-based inpainting methods are tend to produce blur, the exemplar-based methods are prone to error filling and the neural network-based methods are highly dependent on data. Many existing approaches formulate this problem as a general low-rank matrix approximate one which cannot handle this special structural missing very well. In this paper, we propose a novel image inpainting algorithm named nonlocal low-rank tensor completion (NLLRTC) based on the nonlocal self-similarity prior and the low-rank prior. By using the nonlocal self-similarity of image patches, we directly stack these patches into a three-dimensional similar tensor instead of pulling them into column vectors, then the similar tensor can be completed by tensor ring (TR) decomposition. By leveraging the alternating direction method under the augmented Lagrangian multiplier framework, the optimization results can be obtained. Moreover, a weighted nuclear norm is added to the tensor completion model to achieve better inpainting performance, which we call weighted nonlocal low-rank tensor completion (WNLLRTC) algorithm. Our empirical studies show encouraging results on both quantitative assessment and visual interpretation of our proposed methods in comparison to some state-of-the-art algorithms.
引用
收藏
页码:3433 / 3458
页数:26
相关论文
共 50 条
  • [1] Image inpainting algorithm based on tensor decomposition and weighted nuclear norm
    Xuya Liu
    Caiyan Hao
    Zezhao Su
    Zerong Qi
    Shujun Fu
    Yuliang Li
    Hongbin Han
    Multimedia Tools and Applications, 2023, 82 : 3433 - 3458
  • [2] A Non-Local Tensor Completion Algorithm Based on Weighted Tensor Nuclear Norm
    Wang, Wenzhe
    Zheng, Jingjing
    Zhao, Li
    Chen, Huiling
    Zhang, Xiaoqin
    ELECTRONICS, 2022, 11 (19)
  • [3] Weighted Tensor Nuclear Norm Minimization for Color Image Restoration
    Hosono, Kaito
    On, Shunsuke
    Miyata, Takamichi
    IEEE ACCESS, 2019, 7 : 88768 - 88776
  • [4] WEIGHTED TENSOR NUCLEAR NORM MINIMIZATION FOR COLOR IMAGE DENOISING
    Hosono, Kaito
    Ono, Shunsuke
    Miyata, Takamichi
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 3081 - 3085
  • [5] Mural inpainting based on RPCA decomposition of block nuclear norm and entropy weighted clustering sparse representation
    Chen Y.
    Tao M.
    Chen J.
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2021, 53 (08): : 72 - 80
  • [6] A new structure tensor based image inpainting algorithm
    Liu, Ying
    Liu, Chanjuan
    Zou, Hailin
    INTERNATIONAL JOURNAL OF GRID AND UTILITY COMPUTING, 2016, 7 (04) : 294 - 303
  • [7] ANISOTROPIC TOTAL VARIATION REGULARIZED LOW-RANK TENSOR COMPLETION BASED ON TENSOR NUCLEAR NORM FOR COLOR IMAGE INPAINTING
    Jiang, Fei
    Liu, Xiao-Yang
    Lu, Hongtao
    Shen, Ruimin
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1363 - 1367
  • [8] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024,
  • [9] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, : 7621 - 7634
  • [10] A weighted nuclear norm method for tensor completion
    College of Science, China Agricultural University, 100083 Beijing, China
    不详
    不详
    Int. J. Signal Process. Image Process. Pattern Recogn., 1 (1-12):