Low-Light Image and Video Enhancement Using Deep Learning: A Survey

被引:170
|
作者
Li, Chongyi [1 ]
Guo, Chunle [2 ]
Han, Linghao [2 ]
Jiang, Jun [3 ]
Cheng, Ming-Ming [2 ]
Gu, Jinwei [3 ]
Loy, Chen Change [1 ]
机构
[1] Nanyang Technol Univ NTU, S Lab, Singapore 639798, Singapore
[2] Nankai Univ, Coll Comp Sci, Tianjin 300071, Peoples R China
[3] SenseTime, San Jose, CA 95110 USA
关键词
Lighting; Deep learning; Feature extraction; Supervised learning; Cameras; Training data; Photography; Image and video restoration; low-light image dataset; low-light image enhancement platform; computational photography; DYNAMIC HISTOGRAM EQUALIZATION; NETWORK; REPRESENTATION; ILLUMINATION;
D O I
10.1109/TPAMI.2021.3126387
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light image enhancement (LLIE) aims at improving the perception or interpretability of an image captured in an environment with poor illumination. Recent advances in this area are dominated by deep learning-based solutions, where many learning strategies, network structures, loss functions, training data, etc. have been employed. In this paper, we provide a comprehensive survey to cover various aspects ranging from algorithm taxonomy to unsolved open issues. To examine the generalization of existing methods, we propose a low-light image and video dataset, in which the images and videos are taken by different mobile phones' cameras under diverse illumination conditions. Besides, for the first time, we provide a unified online platform that covers many popular LLIE methods, of which the results can be produced through a user-friendly web interface. In addition to qualitative and quantitative evaluation of existing methods on publicly available and our proposed datasets, we also validate their performance in face detection in the dark. This survey together with the proposed dataset and online platform could serve as a reference source for future study and promote the development of this research field. The proposed platform and dataset as well as the collected methods, datasets, and evaluation metrics are publicly available and will be regularly updated. Project page: https://www.mmlab-ntu.com/project/lliv_survey/index.html.
引用
收藏
页码:9396 / 9416
页数:21
相关论文
共 50 条
  • [31] Deep Color Consistent Network for Low-Light Image Enhancement
    Zhang, Zhao
    Zheng, Huan
    Hong, Richang
    Xu, Mingliang
    Yan, Shuicheng
    Wang, Meng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1889 - 1898
  • [32] Deep Multi-path Low-light Image Enhancement
    Li, Siyuan
    Cheng, Qingsha S.
    Zhang, Jianguo
    THIRD INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2020), 2020, : 91 - 96
  • [33] Semantic-Guided Zero-Shot Learning for Low-Light Image/Video Enhancement
    Zheng, Shen
    Gupta, Gaurav
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 581 - 590
  • [34] Light-Aware Contrastive Learning for Low-Light Image Enhancement
    Wu, Xu
    Lai, Zhihui
    Zhou, Jie
    Hou, Xianxu
    Pedrycz, Witold
    Shen, Linlin
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (09)
  • [35] Low-Light Image Enhancement Using Hybrid Deep-Learning and Mixed-Norm Loss Functions
    Oh, JongGeun
    Hong, Min-Cheol
    SENSORS, 2022, 22 (18)
  • [36] Low-light image enhancement using inverted image normalized by atmospheric light
    Jeon, Jong Ju
    Eom, I. I. Kyu
    SIGNAL PROCESSING, 2022, 196
  • [37] Multi-Feature Learning for Low-Light Image Enhancement
    Huang, Wei
    Zhu, Yifeng
    Wang, Rui
    Lu, Xiaofeng
    TWELFTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2020), 2020, 11519
  • [38] LEARNING TO FUSE HETEROGENEOUS FEATURES FOR LOW-LIGHT IMAGE ENHANCEMENT
    Tang, Zhenyu
    Ma, Long
    Shang, Xiaoke
    Fan, Xin
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2100 - 2104
  • [39] LightingNet: An Integrated Learning Method for Low-Light Image Enhancement
    Yang, Shaoliang
    Zhou, Dongming
    Cao, Jinde
    Guo, Yanbu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 29 - 42
  • [40] Degrade Is Upgrade: Learning Degradation for Low-Light Image Enhancement
    Jiang, Kui
    Wang, Zhongyuan
    Wang, Zheng
    Chen, Chen
    Yi, Peng
    Lu, Tao
    Lin, Chia-Wen
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1078 - 1086