Multiframe demosaicing and super-resolution of color images

被引:232
|
作者
Farsiu, S [1 ]
Elad, M
Milanfar, P
机构
[1] Univ Calif Santa Cruz, Dept Elect Engn, Santa Cruz, CA 95064 USA
[2] Technion Israel Inst Technol, Dept Comp Sci, IL-32000 Haifa, Israel
基金
美国国家科学基金会;
关键词
color enhancement; demosaicing; image restoration; robust estimation; robust regularization; super resolution;
D O I
10.1109/TIP.2005.860336
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the last two decades, two related categories of problems have been studied independently in image restoration literature: super-resolution and demosaicing. A closer look at these problems reveals the relation between them, and, as conventional color digital cameras suffer from both low-spatial resolution and color-filtering, it is reasonable to address them in a unified context. In this paper, we propose a fast and robust hybrid method of super-resolution and demosaicing, based on a maximum a posteriori estimation technique by minimizing a multiterm cost function. The L, norm is used for measuring the difference between the projected estimate of the high-resolution image and each low-resolution image, removing outliers in the data and errors due to possibly inaccurate motion estimation. Bilateral regularization is used for spatially regularizing the luminance component, resulting in sharp edges and forcing interpolation along the edges and not across them. Simultaneously, Tikhonov regularization is used to smooth the chrominance components. Finally, an additional regularization term is used to force similar edge location and orientation in different color channels. We show that the minimization of the total cost function is relatively easy and fast. Experimental results on synthetic and real data sets confirm the effectiveness of our method.
引用
收藏
页码:141 / 159
页数:19
相关论文
共 50 条
  • [21] IMPROVED HYBRID DEMOSAICING AND COLOR SUPER-RESOLUTION IMPLEMENTATION USING QUASI-NEWTON ALGORITHMS
    Sorrentino, Diego A.
    Antoniou, Andreas
    2009 IEEE 22ND CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, VOLS 1 AND 2, 2009, : 738 - 741
  • [22] MULTIFRAME RESOLUTION RECOVERY OF RADAR IMAGERY: TOWARDS SUPER-RESOLUTION SENSING
    Shkvarko, Y. V.
    Yanez, J. I.
    Martin del Campo, G. D.
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 4487 - 4490
  • [23] Super-Resolution for Color Imagery
    Herold, Isabella
    Young, S. Susan
    2017 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2017,
  • [24] Multiframe Super-Resolution Reconstruction Using Sparse Directional Regularization
    Li, Yan-Ran
    Dai, Dao-Qing
    Shen, Lixin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2010, 20 (07) : 945 - 956
  • [25] Multiframe super-resolution reconstruction based on cycle-spinning
    Cheng, Yan
    Fang, Xiangzhong
    Hou, Jun
    Yu, Songyu
    2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL I, PTS 1-3, PROCEEDINGS, 2007, : 557 - 560
  • [26] Objective Image Quality Assessment of Multiframe Super-Resolution Methods
    Lukes, Tomas
    Fliegel, Karel
    Klima, Milos
    2013 23RD INTERNATIONAL CONFERENCE RADIOELEKTRONIKA (RADIOELEKTRONIKA), 2013, : 267 - 272
  • [27] Multiframe image super-resolution adapted with local spatial information
    Zhang, Liangpei
    Yuan, Qiangqiang
    Shen, Huanfeng
    Li, Pingxiang
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2011, 28 (03) : 381 - 390
  • [28] Super-Resolution of Multispectral Images
    Vega, M.
    Mateos, J.
    Molina, R.
    Katsaggelos, A. K.
    COMPUTER JOURNAL, 2009, 52 (01): : 153 - 167
  • [29] Quantum Images with Super-Resolution
    Balakin, Dmitriy
    Belinsky, Alexander
    JOURNAL OF RUSSIAN LASER RESEARCH, 2015, 36 (06) : 608 - 617
  • [30] Quantum Images with Super-Resolution
    Dmitriy Balakin
    Alexander Belinsky
    Journal of Russian Laser Research, 2015, 36 : 608 - 617