Multiframe demosaicing and super-resolution of color images

被引:232
|
作者
Farsiu, S [1 ]
Elad, M
Milanfar, P
机构
[1] Univ Calif Santa Cruz, Dept Elect Engn, Santa Cruz, CA 95064 USA
[2] Technion Israel Inst Technol, Dept Comp Sci, IL-32000 Haifa, Israel
基金
美国国家科学基金会;
关键词
color enhancement; demosaicing; image restoration; robust estimation; robust regularization; super resolution;
D O I
10.1109/TIP.2005.860336
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the last two decades, two related categories of problems have been studied independently in image restoration literature: super-resolution and demosaicing. A closer look at these problems reveals the relation between them, and, as conventional color digital cameras suffer from both low-spatial resolution and color-filtering, it is reasonable to address them in a unified context. In this paper, we propose a fast and robust hybrid method of super-resolution and demosaicing, based on a maximum a posteriori estimation technique by minimizing a multiterm cost function. The L, norm is used for measuring the difference between the projected estimate of the high-resolution image and each low-resolution image, removing outliers in the data and errors due to possibly inaccurate motion estimation. Bilateral regularization is used for spatially regularizing the luminance component, resulting in sharp edges and forcing interpolation along the edges and not across them. Simultaneously, Tikhonov regularization is used to smooth the chrominance components. Finally, an additional regularization term is used to force similar edge location and orientation in different color channels. We show that the minimization of the total cost function is relatively easy and fast. Experimental results on synthetic and real data sets confirm the effectiveness of our method.
引用
收藏
页码:141 / 159
页数:19
相关论文
共 50 条
  • [31] Super-resolution reconstruction for color images based on simultaneous sparse approximation
    Li, Min
    Cheng, Jian
    Le, Xiang
    Li, Xiao-Wen
    Guangdianzi Jiguang/Journal of Optoelectronics Laser, 2011, 22 (08): : 1241 - 1245
  • [32] Super-Resolution and Blind Deconvolution For Rational Factors With an Application to Color Images
    Sroubek, Filip
    Flusser, Jan
    Cristobal, Gabriel
    COMPUTER JOURNAL, 2009, 52 (01): : 142 - 152
  • [33] Super-Resolution of Color Halftone Images Using Convolutional Neural Networks
    Novaes, Guilherme Apolinario Silva
    Kim, Hae Yong
    IEEE ACCESS, 2024, 12 : 9082 - 9096
  • [34] Robust super-resolution by fusion of interpolated frames for color and grayscale images
    Karch, Barry K.
    Hardie, Russell C.
    FRONTIERS IN PHYSICS, 2015, 3
  • [35] Adaptive Wiener filter super-resolution of color filter array images
    Karch, Barry K.
    Hardie, Russell C.
    OPTICS EXPRESS, 2013, 21 (16): : 18820 - 18841
  • [36] Multiframe Super Resolution with JPEG2000 Compressed Images
    Narayanan, Barath Narayanan
    Hardie, Russell C.
    PROCEEDINGS OF THE 2015 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2015, : 15 - 18
  • [37] Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model
    Yuan, Qiangqiang
    Zhang, Liangpei
    Shen, Huanfeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (03) : 379 - 392
  • [38] A lorentzian stochastic estimation for a robust and iterative multiframe super-resolution reconstruction
    Patanavijit, V.
    Jitapunkul, S.
    TENCON 2006 - 2006 IEEE REGION 10 CONFERENCE, VOLS 1-4, 2006, : 516 - +
  • [39] Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline
    Qian, Guocheng
    Wang, Yuanhao
    Gu, Jinjin
    Dong, Chao
    Heidrich, Wolfgang
    Ghanem, Bernard
    Ren, Jimmy S.
    2022 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2022,
  • [40] Joint Demosaicing and Super-Resolution (JDSR): Network Design and Perceptual Optimization
    Xu, Xuan
    Ye, Yanfang
    Li, Xin
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 (06) : 968 - 980