Cross-Image Disentanglement for Low-Light Enhancement in Real World

被引:4
|
作者
Guo, Lanqing [1 ]
Wan, Renjie [2 ]
Yang, Wenhan [3 ]
Kot, Alex C. [1 ]
Wen, Bihan [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Jurong West 639798, Singapore
[2] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518055, Peoples R China
关键词
Training; Lighting; Brightness; Reflectivity; Task analysis; Feature extraction; Image enhancement; Low-light enhancement; image restoration; disentanglement; MISALIGNMENT; NETWORKS; RETINEX; SPARSE;
D O I
10.1109/TCSVT.2023.3303574
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in the low-light condition suffer from low visibility and various imaging artifacts, e.g., real noise. Existing supervised algorithms for low-light image enhancement require a large set of pixel-aligned training image pairs, which are hard to prepare in practice. Though some recent unsupervised methods can alleviate such data challenges, many real world artifacts inevitably get falsely amplified in the enhanced results due to the lack of corresponding supervision. In this paper, instead of using perfectly aligned images for training, we creatively employ the misaligned real world images as the guidance, which are considerably easier to collect. Specifically, we propose a Cross-Image Disentanglement Network (CIDN) with weakly supervised learning, to separately extract cross-image brightness and image-specific content features from low/normal-light images. Based on that, CIDN can simultaneously correct the brightness and suppress image artifacts in the feature domain, which largely increases the robustness of the pixel shifts between training pairs. By considering real world corruptions, we propose a new training dataset with misaligned and noisy image pairs and its corresponding evaluation dataset. Experimental results show that our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets. The code implementation is publicly available at: https://github.com/GuoLanqing/CIDN.
引用
收藏
页码:2550 / 2563
页数:14
相关论文
共 50 条
  • [31] Generative adversarial network for low-light image enhancement
    Li, Fei
    Zheng, Jiangbin
    Zhang, Yuan-fang
    IET IMAGE PROCESSING, 2021, 15 (07) : 1542 - 1552
  • [32] Image Enhancement for Remote Photoplethysmography in a Low-Light Environment
    Xi, Lin
    Chen, Weihai
    Zhao, Changchen
    Wu, Xingming
    Wang, Jianhua
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 1 - 7
  • [33] MCCNet: A Multi-scale Cross Connection Network for Low-Light Image Enhancement
    Panda, Santosh Kumar
    Nayak, Devidutta
    Sa, Pankaj Kumar
    COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT I, 2024, 2009 : 488 - 499
  • [34] Retinex-based Low-Light Image Enhancement
    Luo, Rui
    Feng, Yan
    He, Mingxin
    Zhang, Yuliang
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1429 - 1434
  • [35] Low-light color image enhancement based on NSST
    Wu Xiaochu
    Tang Guijin
    Liu Xiaohua
    Cui Ziguan
    Luo Suhuai
    The Journal of China Universities of Posts and Telecommunications, 2019, (05) : 41 - 48
  • [36] Low-light image enhancement by diffusion pyramid with residuals
    Kim, Wonjun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [37] Polarization-Aware Low-Light Image Enhancement
    Zhou, Chu
    Teng, Minggui
    Lyu, Youwei
    Li, Si
    Xu, Chao
    Shi, Boxin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3742 - 3750
  • [38] Dual-band low-light image enhancement
    Aizhong Mi
    Wenhui Luo
    Zhanqiang Huo
    Multimedia Systems, 2024, 30
  • [39] Low-light image enhancement based on normal-light image degradation
    Bai Zhao
    Xiaolin Gong
    Jian Wang
    Lingchao Zhao
    Signal, Image and Video Processing, 2022, 16 : 1409 - 1416
  • [40] Low-Light Image Enhancement by Principle Component Analysis
    Priyanka, Steffi Agino
    Wang, Yuan-Kai
    Huang, Shih-Yu
    IEEE ACCESS, 2019, 7 : 3082 - 3092