Image inpainting algorithm based on tensor decomposition and weighted nuclear norm

被引:4
|
作者
Liu, Xuya [1 ]
Hao, Caiyan [2 ]
Su, Zezhao [3 ]
Qi, Zerong [4 ]
Fu, Shujun [5 ]
Li, Yuliang [6 ]
Han, Hongbin [7 ,8 ]
机构
[1] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Qingdao Hiimage Technol Co Ltd, Qingdao 266000, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Shantou 515063, Peoples R China
[4] Shandong Chengshi Elect Technol Ltd Co, Jinan 250031, Peoples R China
[5] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[6] Shandong Univ, Dept Intervent Med, Hosp 2, Jinan 250100, Peoples R China
[7] Peking Univ Third Hosp, Dept Radiol, Beijing 100089, Peoples R China
[8] Beijing Key Lab Magnet Resonance Imaging Equipmen, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Low-rank approximation; Nonlocal similarity; Tensor completion; Tensor ring decomposition; MATRIX COMPLETION;
D O I
10.1007/s11042-022-12635-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a damaged image, recovering an image with missing entire rows or columns is a challenging problem arising in many real applications, such as digital image inpainting. For this kind of information missing situation, the diffusion-based inpainting methods are tend to produce blur, the exemplar-based methods are prone to error filling and the neural network-based methods are highly dependent on data. Many existing approaches formulate this problem as a general low-rank matrix approximate one which cannot handle this special structural missing very well. In this paper, we propose a novel image inpainting algorithm named nonlocal low-rank tensor completion (NLLRTC) based on the nonlocal self-similarity prior and the low-rank prior. By using the nonlocal self-similarity of image patches, we directly stack these patches into a three-dimensional similar tensor instead of pulling them into column vectors, then the similar tensor can be completed by tensor ring (TR) decomposition. By leveraging the alternating direction method under the augmented Lagrangian multiplier framework, the optimization results can be obtained. Moreover, a weighted nuclear norm is added to the tensor completion model to achieve better inpainting performance, which we call weighted nonlocal low-rank tensor completion (WNLLRTC) algorithm. Our empirical studies show encouraging results on both quantitative assessment and visual interpretation of our proposed methods in comparison to some state-of-the-art algorithms.
引用
收藏
页码:3433 / 3458
页数:26
相关论文
共 50 条
  • [41] Dynamic MRI Reconstruction via Weighted Tensor Nuclear Norm Regularizer
    Cui, Kaiyan
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (08) : 3052 - 3060
  • [42] A Two-Step Image Inpainting Algorithm Using Tensor SVD
    Ghorai, Mrinmoy
    Mandal, Sekhar
    Chanda, Bhabatosh
    COMPUTER VISION - ACCV 2014 WORKSHOPS, PT II, 2015, 9009 : 63 - 77
  • [43] Nonlocal B-spline representation of tensor decomposition for hyperspectral image inpainting
    Xu, Honghui
    Qin, Mengjie
    Yan, Yidong
    Zhang, Meiyu
    Zheng, Jianwei
    SIGNAL PROCESSING, 2023, 206
  • [44] Research of image inpainting algorithm based on image segmentation
    Ou, Xianfeng
    Yan, Pengcheng
    Hu, Wenjing
    Wu, Jianhui
    Tu, Bing
    Guo, Longyuan
    Peng, Xin
    Zhang, Guoyun
    Wang, Peng
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2018, 18 (03) : 637 - 644
  • [45] Weighted Order-p Tensor Nuclear Norm Minimization and Its Application to Hyperspectral Image Mixed Denoising
    He, Chengxun
    Cao, Qiujie
    Xu, Yang
    Sun, Le
    Wu, Zebin
    Wei, Zhihui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [46] An Adaptive Image Inpainting Method Based on the Weighted Mean
    Nguyen Hoang Hai
    Le Minh Hieu
    Thanh, Dang N. H.
    Nguyen Van Son
    Prasath, V. B. Surya
    INFORMATICA-JOURNAL OF COMPUTING AND INFORMATICS, 2019, 43 (04): : 507 - 513
  • [47] An Improved Image Inpainting Algorithm based on Image Segmentation
    Ying, Huang
    Kai, Li
    Ming, Yang
    ADVANCES IN INFORMATION AND COMMUNICATION TECHNOLOGY, 2017, 107 : 796 - 801
  • [48] Structure tensor total variation-regularized weighted nuclear norm minimization for hyperspectral image mixed denoising
    Wu, Zhaojun
    Wang, Qiang
    Jin, Jing
    Shen, Yi
    SIGNAL PROCESSING, 2017, 131 : 202 - 219
  • [49] A multispectral image compression and encryption algorithm based on tensor decomposition and chaos
    Xu D.
    Du L.
    High Technology Letters, 2022, 28 (02) : 134 - 141
  • [50] A multispectral image compression and encryption algorithm based on tensor decomposition and chaos
    徐冬冬
    DU Limin
    HighTechnologyLetters, 2022, 28 (02) : 134 - 141