Residual Quotient Learning for Zero-Reference Low-Light Image Enhancement

被引:0
|
作者
Xie, Chao [1 ]
Fei, Linfeng [1 ]
Tao, Huanjie [2 ]
Hu, Yaocong [3 ]
Zhou, Wei [4 ]
Hoe, Jiun Tian [5 ]
Hu, Weipeng [5 ]
Tan, Yap-Peng [5 ]
机构
[1] Nanjing Forestry Univ, Coll Mech & Elect Engn, Nanjing 210037, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[3] Anhui Polytech Univ, Sch Elect Engn, Wuhu 241000, Peoples R China
[4] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou 510006, Guangdong, Peoples R China
[5] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Lighting; Training; Image enhancement; Chaos; Reflectivity; Optimization; Neural networks; Image restoration; Image color analysis; Face detection; Low-light image enhancement; residual quotient learning; zero reference; deep learning; NETWORK; REPRESENTATION;
D O I
10.1109/TIP.2024.3519997
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, neural networks have become the dominant approach to low-light image enhancement (LLIE), with at least one-third of them adopting a Retinex-related architecture. However, through in-depth analysis, we contend that this most widely accepted LLIE structure is suboptimal, particularly when addressing the non-uniform illumination commonly observed in natural images. In this paper, we present a novel variant learning framework, termed residual quotient learning, to substantially alleviate this issue. Instead of following the existing Retinex-related decomposition-enhancement-reconstruction process, our basic idea is to explicitly reformulate the light enhancement task as adaptively predicting the latent quotient with reference to the original low-light input using a residual learning fashion. By leveraging the proposed residual quotient learning, we develop a lightweight yet effective network called ResQ-Net. This network features enhanced non-uniform illumination modeling capabilities, making it more suitable for real-world LLIE tasks. Moreover, due to its well-designed structure and reference-free loss function, ResQ-Net is flexible in training as it allows for zero-reference optimization, which further enhances the generalization and adaptability of our entire framework. Extensive experiments on various benchmark datasets demonstrate the merits and effectiveness of the proposed residual quotient learning, and our trained ResQ-Net outperforms state-of-the-art methods both qualitatively and quantitatively. Furthermore, a practical application in dark face detection is explored, and the preliminary results confirm the potential and feasibility of our method in real-world scenarios.
引用
收藏
页码:365 / 378
页数:14
相关论文
共 50 条
  • [21] Rethinking Zero-DCE for Low-Light Image Enhancement
    Mi, Aizhong
    Luo, Wenhui
    Qiao, Yingxu
    Huo, Zhanqiang
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [22] Rethinking Zero-DCE for Low-Light Image Enhancement
    Aizhong Mi
    Wenhui Luo
    Yingxu Qiao
    Zhanqiang Huo
    Neural Processing Letters, 56
  • [23] Zero-shot Learning for Low-light Image Enhancement Based on Dual Iteration
    Xiang Sen
    Wang Yingfeng
    Deng Huiping
    Wu Jin
    Yu Li
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (10) : 3379 - 3388
  • [24] Learning Multi-scale Retinex with Residual Network for Low-Light Image Enhancement
    Ma, Long
    Lin, Jie
    Shang, Jingjie
    Zhong, Wei
    Fan, Xin
    Luo, Zhongxuan
    Liu, Risheng
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2020, 2020, 12305 : 291 - 302
  • [25] Underwater Image Enhancement Based on Zero-Reference Deep Network
    Huang, Yifan
    Yuan, Fei
    Xiao, Fengqi
    Lu, Jianxiang
    Cheng, En
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2023, 48 (03) : 903 - 924
  • [26] Semantically Contrastive Learning for Low-Light Image Enhancement
    Liang, Dong
    Li, Ling
    Wei, Mingqiang
    Yang, Shuo
    Zhang, Liyan
    Yang, Wenhan
    Du, Yun
    Zhou, Huiyu
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1555 - 1563
  • [27] ExposureDiffusion: Learning to Expose for Low-light Image Enhancement
    Wang, Yufei
    Yu, Yi
    Yang, Wenhan
    Guo, Lanqing
    Chau, Lap-Pui
    Kot, Alex C.
    Wen, Bihan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12404 - 12414
  • [28] Low-Light Image Enhancement via Unsupervised Learning
    He, Wenchao
    Liu, Yutao
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT I, 2024, 14473 : 232 - 243
  • [29] Learning Color Representations for Low-Light Image Enhancement
    Kim, Bomi
    Lee, Sunhyeok
    Kim, Nahyun
    Jang, Donggon
    Kim, Dae-Shik
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 904 - 912
  • [30] Semantic-Guided Zero-Shot Learning for Low-Light Image/Video Enhancement
    Zheng, Shen
    Gupta, Gaurav
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 581 - 590