Low-Light Image and Video Enhancement Using Deep Learning: A Survey

被引:170
|
作者
Li, Chongyi [1 ]
Guo, Chunle [2 ]
Han, Linghao [2 ]
Jiang, Jun [3 ]
Cheng, Ming-Ming [2 ]
Gu, Jinwei [3 ]
Loy, Chen Change [1 ]
机构
[1] Nanyang Technol Univ NTU, S Lab, Singapore 639798, Singapore
[2] Nankai Univ, Coll Comp Sci, Tianjin 300071, Peoples R China
[3] SenseTime, San Jose, CA 95110 USA
关键词
Lighting; Deep learning; Feature extraction; Supervised learning; Cameras; Training data; Photography; Image and video restoration; low-light image dataset; low-light image enhancement platform; computational photography; DYNAMIC HISTOGRAM EQUALIZATION; NETWORK; REPRESENTATION; ILLUMINATION;
D O I
10.1109/TPAMI.2021.3126387
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light image enhancement (LLIE) aims at improving the perception or interpretability of an image captured in an environment with poor illumination. Recent advances in this area are dominated by deep learning-based solutions, where many learning strategies, network structures, loss functions, training data, etc. have been employed. In this paper, we provide a comprehensive survey to cover various aspects ranging from algorithm taxonomy to unsolved open issues. To examine the generalization of existing methods, we propose a low-light image and video dataset, in which the images and videos are taken by different mobile phones' cameras under diverse illumination conditions. Besides, for the first time, we provide a unified online platform that covers many popular LLIE methods, of which the results can be produced through a user-friendly web interface. In addition to qualitative and quantitative evaluation of existing methods on publicly available and our proposed datasets, we also validate their performance in face detection in the dark. This survey together with the proposed dataset and online platform could serve as a reference source for future study and promote the development of this research field. The proposed platform and dataset as well as the collected methods, datasets, and evaluation metrics are publicly available and will be regularly updated. Project page: https://www.mmlab-ntu.com/project/lliv_survey/index.html.
引用
收藏
页码:9396 / 9416
页数:21
相关论文
共 50 条
  • [41] Edge-Computing-Enabled Deep Learning Approach for Low-Light Satellite Image Enhancement
    Bui, Trong-An
    Lee, Pei-Jun
    Liang, Chun-Sheng
    Hsu, Pei-Hsiang
    Shiu, Shiuan-Hal
    Tsai, Chen-Kai
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4071 - 4083
  • [42] Enhancement of Infrared Imagery through Low-Light Image Guidance Leveraging Deep Learning Techniques
    Gan, Yong
    Wang, Yuefeng
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [43] Unrolled Decomposed Unpaired Learning for Controllable Low-Light Video Enhancement
    Zhu, Lingyu
    Yang, Wenhan
    Chen, Baoliang
    Zhu, Hanwei
    Ni, Zhangkai
    Mao, Qi
    Wang, Shiqi
    COMPUTER VISION - ECCV 2024, PT XXIII, 2025, 15081 : 329 - 347
  • [44] Deep learning-based low-light image enhancement method for driving behavior recognition
    Zhang, Chenjie
    Li, Jialu
    Hu, Hanping
    Bai, Xuemei
    2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, : 344 - 349
  • [45] Low-Light Stereo Image Enhancement
    Huang, Jie
    Fu, Xueyang
    Xiao, Zeyu
    Zhao, Feng
    Xiong, Zhiwei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2978 - 2992
  • [46] Low-Light Hyperspectral Image Enhancement
    Li, Xuelong
    Li, Guanlin
    Zhao, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [47] Decoupled Low-Light Image Enhancement
    Hao, Shijie
    Han, Xu
    Guo, Yanrong
    Wang, Meng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (04)
  • [48] Low-Light Image Enhancement Based on Deep Convolutional Neural Network
    Ma Hongqiang
    Ma Shiping
    Xu Yuelei
    Zhu Mingming
    ACTA OPTICA SINICA, 2019, 39 (02)
  • [49] Deep Multi-Illumination Fusion for Low-Light Image Enhancement
    Zhong, Wei
    Lin, Jie
    Ma, Long
    Liu, Risheng
    Fan, Xin
    PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 140 - 150
  • [50] Deep parametric Retinex decomposition model for low-light image enhancement
    Li, Xiaofang
    Wang, Weiwei
    Feng, Xiangchu
    Li, Min
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 241