Using Deep Neural Networks for Inverse Problems in Imaging Beyond analytical methods

被引:376
|
作者
Lucas, Alice [1 ,2 ]
Iliadis, Michael [3 ]
Molina, Rafael [4 ]
Katsaggelos, Aggelos K. [1 ,5 ]
机构
[1] Northwestern Univ, Elect Engn & Comp Sci Dept, Evanston, IL 60208 USA
[2] Image & Video Proc Lab, Evanston, IL 60208 USA
[3] Sony US Res Ctr, San Jose, CA USA
[4] Univ Granada, Comp Sci & Artificial Intelligence, Granada, Spain
[5] Northwestern Univ, Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/MSP.2017.2760358
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditionally, analytical methods have been used to solve imaging problems such as image restoration, inpainting, and superresolution (SR). In recent years, the fields of machine and deep learning have gained a lot of momentum in solving such imaging problems, often surpassing the performance provided by analytical approaches. Unlike analytical methods for which the problem is explicitly defined and domain-knowledge carefully engineered into the solution, deep neural networks (DNNs) do not benefit from such prior knowledge and instead make use of large data sets to learn the unknown solution to the inverse problem. In this article, we review deep-learning techniques for solving such inverse problems in imaging. More specifically, we review the popular neural network architectures used for imaging tasks, offering some insight as to how these deep-learning tools can solve the inverse problem. Furthermore, we address some fundamental questions, such as how deeplearning and analytical methods can be combined to provide better solutions to the inverse problem in addition to providing a discussion on the current limitations and future directions of the use of deep learning for solving inverse problem in imaging. © 2017 IEEE.
引用
收藏
页码:20 / 36
页数:17
相关论文
共 50 条
  • [41] Neumann Networks for Linear Inverse Problems in Imaging
    Gilton, Davis
    Ongie, Greg
    Willett, Rebecca
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 328 - 343
  • [42] Neural networks for inverse problems using principal component analysis and orthogonal arrays
    Kim, Yong Y.
    Kapania, Rakesh K.
    AIAA Journal, 2006, 44 (07): : 1628 - 1634
  • [43] Inverse design of colored daytime radiative coolers using deep neural networks
    Keawmuang, Harit
    Badloe, Trevon
    Lee, Chihun
    Park, Junkyeong
    Rho, Junsuk
    SOLAR ENERGY MATERIALS AND SOLAR CELLS, 2024, 271
  • [44] SOLVING INVERSE PROBLEMS OF OBTAINING SUPER-RESOLUTION USING NEURAL NETWORKS
    Lagovsky, B. A.
    Nasonov, I. A.
    Rubinovich, E. Y.
    BULLETIN OF THE SOUTH URAL STATE UNIVERSITY SERIES-MATHEMATICAL MODELLING PROGRAMMING & COMPUTER SOFTWARE, 2024, 17 (01): : 37 - 48
  • [45] SOLVING INVERSE PROBLEMS OF ACHIEVING SUPER-RESOLUTION USING NEURAL NETWORKS
    Lagovsky, B. A.
    Rubinovich, E. Y.
    Yurchenkov, I. A.
    BULLETIN OF THE SOUTH URAL STATE UNIVERSITY SERIES-MATHEMATICAL MODELLING PROGRAMMING & COMPUTER SOFTWARE, 2025, 18 (01): : 104 - 117
  • [46] INVERSE MODEL FOR FIRE HEAT RELEASE RATE USING DEEP NEURAL NETWORKS
    Kou, Luyao
    Wang, Xinzhi
    Zhang, Hui
    Yang, Rui
    Liu, Yi
    PROCEEDINGS OF THE ASME 2020 HEAT TRANSFER SUMMER CONFERENCE (HT2020), 2020,
  • [47] Neural networks for inverse problems using principal component analysis and orthogonal arrays
    Kim, Yong Y.
    Kapania, Rakesh K.
    AIAA JOURNAL, 2006, 44 (07) : 1628 - 1634
  • [48] Inverse problems using Artificial Neural Networks in long range atmospheric dispersion
    Sharma, P. K.
    Gera, B.
    Ghosh, A. K.
    KERNTECHNIK, 2011, 76 (02) : 115 - 120
  • [49] Deep Neural Networks for Inverse Problems with Pseudodifferential Operators: An Application to Limited-Angle Tomography
    Bubba, Tatiana A.
    Galinier, Mathilde
    Lassas, Matti
    Prato, Marco
    Ratti, Luca
    Siltanen, Samuli
    SIAM JOURNAL ON IMAGING SCIENCES, 2021, 14 (02): : 470 - 505
  • [50] Methods for Pruning Deep Neural Networks
    Vadera, Sunil
    Ameen, Salem
    IEEE ACCESS, 2022, 10 : 63280 - 63300