Image inpainting algorithm based on tensor decomposition and weighted nuclear norm

被引:4
|
作者
Liu, Xuya [1 ]
Hao, Caiyan [2 ]
Su, Zezhao [3 ]
Qi, Zerong [4 ]
Fu, Shujun [5 ]
Li, Yuliang [6 ]
Han, Hongbin [7 ,8 ]
机构
[1] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Qingdao Hiimage Technol Co Ltd, Qingdao 266000, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Shantou 515063, Peoples R China
[4] Shandong Chengshi Elect Technol Ltd Co, Jinan 250031, Peoples R China
[5] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[6] Shandong Univ, Dept Intervent Med, Hosp 2, Jinan 250100, Peoples R China
[7] Peking Univ Third Hosp, Dept Radiol, Beijing 100089, Peoples R China
[8] Beijing Key Lab Magnet Resonance Imaging Equipmen, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Low-rank approximation; Nonlocal similarity; Tensor completion; Tensor ring decomposition; MATRIX COMPLETION;
D O I
10.1007/s11042-022-12635-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a damaged image, recovering an image with missing entire rows or columns is a challenging problem arising in many real applications, such as digital image inpainting. For this kind of information missing situation, the diffusion-based inpainting methods are tend to produce blur, the exemplar-based methods are prone to error filling and the neural network-based methods are highly dependent on data. Many existing approaches formulate this problem as a general low-rank matrix approximate one which cannot handle this special structural missing very well. In this paper, we propose a novel image inpainting algorithm named nonlocal low-rank tensor completion (NLLRTC) based on the nonlocal self-similarity prior and the low-rank prior. By using the nonlocal self-similarity of image patches, we directly stack these patches into a three-dimensional similar tensor instead of pulling them into column vectors, then the similar tensor can be completed by tensor ring (TR) decomposition. By leveraging the alternating direction method under the augmented Lagrangian multiplier framework, the optimization results can be obtained. Moreover, a weighted nuclear norm is added to the tensor completion model to achieve better inpainting performance, which we call weighted nonlocal low-rank tensor completion (WNLLRTC) algorithm. Our empirical studies show encouraging results on both quantitative assessment and visual interpretation of our proposed methods in comparison to some state-of-the-art algorithms.
引用
收藏
页码:3433 / 3458
页数:26
相关论文
共 50 条
  • [21] Fast Tensor Nuclear Norm for Structured Low-Rank Visual Inpainting
    Xu, Honghui
    Zheng, Jianwei
    Yao, Xiaomin
    Feng, Yuchao
    Chen, Shengyong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (02) : 538 - 552
  • [22] Multiple graphs learning with a new weighted tensor nuclear norm
    Xie, Deyan
    Gao, Quanxue
    Deng, Siyang
    Yang, Xiaojun
    Gao, Xinbo
    NEURAL NETWORKS, 2021, 133 : 57 - 68
  • [23] Traffic Matrix Completion by Weighted Tensor Nuclear Norm Minimization
    Miyata, Takamichi
    2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2023,
  • [24] Image inpainting by low-rank tensor decomposition and multidirectional search
    Liu, Xuya
    Hao, Caiyan
    Su, Zezhao
    Qi, Zerong
    Fu, Shujun
    Li, Yuliang
    Han, Hongbin
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (05)
  • [25] A Novel Image Inpainting Method based on Image Decomposition
    Wang, Minqin
    CEIS 2011, 2011, 15
  • [26] Quaternion Tensor Left Ring Decomposition and Application for Color Image Inpainting
    Miao, Jifei
    Kou, Kit Ian
    Cai, Hongmin
    Liu, Lizhi
    JOURNAL OF SCIENTIFIC COMPUTING, 2024, 101 (01)
  • [27] Nonlocal Patch-Based Fully Connected Tensor Network Decomposition for Multispectral Image Inpainting
    Zheng, Wen-Jie
    Zhao, Xi-Le
    Zheng, Yu-Bang
    Pang, Zhi-Feng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [28] A weighted inpainting algorithm based on TV model
    Wang, Xiaoyun
    Gao, Zhihui
    Zhang, Xianquan
    Yu, Chunqiang
    Ni, Bin
    Ding, Feng
    International Journal of Digital Content Technology and its Applications, 2012, 6 (11) : 297 - 304
  • [29] Multi-Channel Audio Completion Algorithm Based on Tensor Nuclear Norm
    Zhu, Lin
    Yang, Lidong
    Guo, Yong
    Niu, Dawei
    Zhang, Dandan
    ELECTRONICS, 2024, 13 (09)
  • [30] Joint Weighted Tensor Schatten p-Norm and Tensor lp-Norm Minimization for Image Denoising
    Zhang, Xiaoqin
    Zheng, Jingjing
    Yan, Yufang
    Zhao, Li
    Jiang, Runhua
    IEEE ACCESS, 2019, 7 : 20273 - 20280