Cross-Image Disentanglement for Low-Light Enhancement in Real World

被引:4
|
作者
Guo, Lanqing [1 ]
Wan, Renjie [2 ]
Yang, Wenhan [3 ]
Kot, Alex C. [1 ]
Wen, Bihan [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Jurong West 639798, Singapore
[2] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518055, Peoples R China
关键词
Training; Lighting; Brightness; Reflectivity; Task analysis; Feature extraction; Image enhancement; Low-light enhancement; image restoration; disentanglement; MISALIGNMENT; NETWORKS; RETINEX; SPARSE;
D O I
10.1109/TCSVT.2023.3303574
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in the low-light condition suffer from low visibility and various imaging artifacts, e.g., real noise. Existing supervised algorithms for low-light image enhancement require a large set of pixel-aligned training image pairs, which are hard to prepare in practice. Though some recent unsupervised methods can alleviate such data challenges, many real world artifacts inevitably get falsely amplified in the enhanced results due to the lack of corresponding supervision. In this paper, instead of using perfectly aligned images for training, we creatively employ the misaligned real world images as the guidance, which are considerably easier to collect. Specifically, we propose a Cross-Image Disentanglement Network (CIDN) with weakly supervised learning, to separately extract cross-image brightness and image-specific content features from low/normal-light images. Based on that, CIDN can simultaneously correct the brightness and suppress image artifacts in the feature domain, which largely increases the robustness of the pixel shifts between training pairs. By considering real world corruptions, we propose a new training dataset with misaligned and noisy image pairs and its corresponding evaluation dataset. Experimental results show that our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets. The code implementation is publicly available at: https://github.com/GuoLanqing/CIDN.
引用
收藏
页码:2550 / 2563
页数:14
相关论文
共 50 条
  • [41] Low-Light Image Enhancement Based on Transmission Normalization
    Yang A.
    Song C.
    Zhang L.
    Bai H.
    Bu L.
    Yang, Aiping (yangaiping@tju.edu.cn), 2017, Tianjin University (50): : 997 - 1003
  • [42] Low-Light Image Enhancement for Multiaperture and Multitap Systems
    Conde, Miguel Heredia
    Zhang, Bo
    Kagawa, Keiichiro
    Loffeld, Otmar
    IEEE PHOTONICS JOURNAL, 2016, 8 (02):
  • [43] Semantically Contrastive Learning for Low-Light Image Enhancement
    Liang, Dong
    Li, Ling
    Wei, Mingqiang
    Yang, Shuo
    Zhang, Liyan
    Yang, Wenhan
    Du, Yun
    Zhou, Huiyu
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1555 - 1563
  • [44] A Pipeline Neural Network for Low-Light Image Enhancement
    Guo, Yanhui
    Ke, Xue
    Ma, Jie
    Zhang, Jun
    IEEE ACCESS, 2019, 7 : 13737 - 13744
  • [45] Low-light color image enhancement based on NSST
    Xiaochu W.
    Guijin T.
    Xiaohua L.
    Ziguan C.
    Suhuai L.
    Journal of China Universities of Posts and Telecommunications, 2019, 26 (05): : 41 - 48
  • [46] Weight Uncertainty Network for Low-Light Image Enhancement
    Jin, Yutao
    Sun, Yue
    Chen, Xiaoyan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VIII, ICIC 2024, 2024, 14869 : 106 - 117
  • [47] Gradient-Based Low-Light Image Enhancement
    Tanaka, Masayuki
    Shibata, Takashi
    Okutomi, Masatoshi
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2019,
  • [48] LOW-LIGHT IMAGE ENHANCEMENT VIA FEATURE RESTORATION
    Yang, Yang
    Zhang, Yonghua
    Guo, Xiaojie
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2440 - 2444
  • [49] Task Decoupling Guided Low-Light Image Enhancement
    Niu Y.-Z.
    Chen M.-M.
    Li Y.-Z.
    Zhao T.-S.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (01): : 34 - 45
  • [50] Perceptual Quality Assessment of Low-light Image Enhancement
    Zhai, Guangtao
    Sun, Wei
    Min, Xiongkuo
    Zhou, Jiantao
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (04)