CLE Diffusion: Controllable Light Enhancement Diffusion Model

被引:16
|
作者
Yin, Yuyang [1 ]
Xu, Dejia [2 ]
Tan, Chuangchuang [1 ]
Liu, Ping [3 ]
Zhao, Yao [1 ]
Wei, Yunchao [1 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing Key Lab Adv Informat Sci & Network, Beijing, Peoples R China
[2] Univ Texas Austin, VITA Grp, Austin, TX USA
[3] ASTAR, IHPC, Ctr Frontier AI Res, Singapore, Singapore
关键词
image processing; low light image enhancement; diffusion model; ILLUMINATION; RETINEX;
D O I
10.1145/3581783.3612145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low light enhancement has gained increasing importance with the rapid development of visual creation and editing. However, most existing enhancement algorithms are designed to homogeneously increase the brightness of images to a pre-defined extent, limiting the user experience. To address this issue, we propose Controllable Light Enhancement Diffusion Model, dubbed CLE Diffusion, a novel diffusion framework to provide users with rich controllability. Built with a conditional diffusion model, we introduce an illumination embedding to let users control their desired brightness level. Additionally, we incorporate the Segment-Anything Model (SAM) to enable user-friendly region controllability, where users can click on objects to specify the regions they wish to enhance. Extensive experiments demonstrate that CLE Diffusion achieves competitive performance regarding quantitative metrics, qualitative results, and versatile controllability. Project page: https://yuyangyin.github.io/CLEDiffusion/
引用
收藏
页码:8145 / 8156
页数:12
相关论文
共 50 条
  • [1] Controllable Light Diffusion for Portraits
    Futschik, David
    Ritland, Kelvin
    Vecore, James
    Fanello, Sean
    Orts-Escolano, Sergio
    Curless, Brian
    Sjkora, Daniel
    Pandey, Rohit
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8412 - 8421
  • [2] Low Light Enhancement in Street Scenes Based on Diffusion Model
    Xia, Rui
    Wang, Lisong
    Li, Taili
    Shi, Pingping
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1491 - 1496
  • [3] Controllable Mind Visual Diffusion Model
    Zeng, Bohan
    Li, Shanglin
    Liu, Xuhui
    Gao, Sicheng
    Jiang, Xiaolong
    Tang, Xu
    Hu, Yao
    Liu, Jianzhuang
    Zhang, Baochang
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 6935 - 6943
  • [4] AnlightenDiff: Anchoring Diffusion Probabilistic Model on Low Light Image Enhancement
    Chan, Cheuk-Yiu
    Siu, Wan-Chi
    Chan, Yuk-Hee
    Chan, H. Anthony
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6324 - 6339
  • [5] Low Light Image Enhancement Based on Retinex Theory and Diffusion Model
    Chen, Tao
    Liu, Dongmei
    PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING, ICDSP 2024, 2024, : 21 - 26
  • [6] PSC diffusion: patch-based simplified conditional diffusion model for low-light image enhancement
    Wan, Fei
    Xu, Bingxin
    Pan, Weiguo
    Liu, Hongzhe
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [7] LayoutDM: Discrete Diffusion Model for Controllable Layout Generation
    Inoue, Naoto
    Kikuchi, Kotaro
    Simo-Serra, Edgar
    Otani, Mayu
    Yamaguchi, Kota
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10167 - 10176
  • [8] CAGEN: CONTROLLABLE ANOMALY GENERATOR USING DIFFUSION MODEL
    Jiang, Bolin
    Xie, Yuqiu
    Li, Jiawei
    Li, Naiqi
    Jiang, Yong
    Xia, Shu-Tao
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 3110 - 3114
  • [9] Scenario Diffusion: Controllable Driving Scenario Generation With Diffusion
    Pronovost, Ethan
    Ganesina, Meghana Reddy
    Hendy, Noureldin
    Wang, Zeyu
    Morales, Andres
    Wang, Kai
    Roy, Nicholas
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [10] L2DM: A Diffusion Model for Low-Light Image Enhancement
    Lv, Xingguo
    Dong, Xingbo
    Jin, Zhe
    Zhang, Hui
    Song, Siyi
    Li, Xuejun
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI, 2024, 14435 : 130 - 145