Deep and Low-Rank Quaternion Priors for Color Image Processing

被引:13
|
作者
Xu, Tingting [1 ]
Kong, Xiaoyu [1 ]
Shen, Qiangqiang [2 ]
Chen, Yongyong [1 ,3 ]
Zhou, Yicong [4 ]
机构
[1] Harbin Inst Technol Shenzhen, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[2] Harbin Inst Technol Shenzhen, Sch Elect & Informat Engn, Shenzhen 518055, Peoples R China
[3] Guangdong Prov Key Lab Novel Secur Intelligence T, Shenzhen 518055, Peoples R China
[4] Univ Macau, Dept Comp & Informat Sci, Macau, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-rank quaternion representation; deep prior; plug-and-play; color image denoising; color image inpainting; NUCLEAR NORM; SPARSE REPRESENTATION; RESTORATION; FACTORIZATION; COMPLETION;
D O I
10.1109/TCSVT.2022.3233589
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the physical nature of color images, color image processing such as denoising and inpainting has shown extensive and versatile possibilities over grayscale image processing. The monochromatic and the concatenation model have been widely used to process color images by processing each color channel independently or concatenating three color channels as one unified one and then used existing grayscale image processing methods directly without specific operations. These above schemes, however, have some limitations: (1) they would destroy the inherent correlation among three color channels since they cannot represent color images holistically; (2) they usually focus on one specific handcrafted prior such as smoothness, low-rankness, or even deep prior and thus failing to fuse deep and handcrafted priors of color images flexibly. To conquer these limitations, we propose one unified model to integrate deep prior and low-rank quaternion prior (DLRQP) for color image processing under the plug-and-play (PnP) framework. Specifically, the quaternion representation with low-rank constraint is introduced to denote the color image in a holistic way and one advanced denoiser is adopted to explore the deep prior in an iterative process. To tightly approximate the quaternion rank, one nonconvex penalty function is further utilized. We derive an alternate iterative approach to tackle the proposed model. We empirically demonstrate that our model can achieve superior performance over existing methods on both color image denoising and inpainting tasks.
引用
收藏
页码:3119 / 3132
页数:14
相关论文
共 50 条
  • [1] Low-Rank Quaternion Approximation for Color Image Processing
    Chen, Yongyong
    Xiao, Xiaolin
    Zhou, Yicong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 1426 - 1439
  • [2] Image Restoration: From Sparse and Low-Rank Priors to Deep Priors
    Zhang, Lei
    Zuo, Wangmeng
    IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (05) : 172 - 179
  • [3] COLOR IMAGE INPAINTING BASED ON LOW-RANK QUATERNION MATRIX FACTORIZATION
    Xu, Junxia
    Chen, Yannan
    Zhang, Xinzhen
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2024, 20 (02) : 825 - 837
  • [4] COLOR IMAGE COMPLETION USING A LOW-RANK QUATERNION MATRIX APPROXIMATION
    Chen, Yannan
    Qi, Liqun
    Zhang, Xinzhen
    PACIFIC JOURNAL OF OPTIMIZATION, 2022, 18 (01): : 55 - 75
  • [5] Quaternion-Aware Low-Rank Prior for Blind Color Image Deblurring
    Zhang, Hao
    Qi, Te
    Zeng, Tieyong
    JOURNAL OF SCIENTIFIC COMPUTING, 2024, 101 (02)
  • [6] Color Image Recovery Using Low-Rank Quaternion Matrix Completion Algorithm
    Miao, Jifei
    Kou, Kit Ian
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 190 - 201
  • [7] Combined Deep Priors With Low-Rank Tensor Factorization for Hyperspectral Image Restoration
    Zhang, Qiang
    Dong, Yushuai
    Yuan, Qiangqiang
    Song, Meiping
    Yu, Haoyang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [8] Combined Deep Priors With Low-Rank Tensor Factorization for Hyperspectral Image Restoration
    Zhang, Qiang
    Dong, Yushuai
    Yuan, Qiangqiang
    Song, Meiping
    Yu, Haoyang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [9] Low Rank Priors for Color Image Regularization
    Moellenhoff, Thomas
    Strekalovskiy, Evgeny
    Moeller, Michael
    Cremers, Daniel
    ENERGY MINIMIZATION METHODS IN COMPUTER VISION AND PATTERN RECOGNITION, EMMCVPR 2015, 2015, 8932 : 126 - 140
  • [10] Efficient low-rank quaternion matrix completion under the learnable transforms for color image recovery
    Wu, Pengling
    Kou, Kit Ian
    Miao, Jifei
    APPLIED MATHEMATICS LETTERS, 2024, 148