HDR-NeRF: High Dynamic Range Neural Radiance Fields

被引:57
|
作者
Huang, Xin [1 ,2 ]
Zhang, Qi [2 ]
Feng, Ying [2 ]
Li, Hongdong [3 ]
Wang, Xuan [2 ]
Wang, Qing [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Tencent AI Lab, Shenzhen, Peoples R China
[3] Australian Natl Univ, Canberra, ACT, Australia
关键词
D O I
10.1109/CVPR52688.2022.01785
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and novel LDR views under different exposures. The key to our method is to model the simplified physical imaging process, which dictates that the radiance of a scene point transforms to a pixel value in the LDR image with two implicit functions: a radiance field and a tone mapper. The radiance field encodes the scene radiance (values vary from 0 to +infinity), which outputs the density and radiance of a ray by giving corresponding ray origin and ray direction. The tone mapper models the mapping process that a ray hitting on the camera sensor becomes a pixel value. The color of the ray is predicted by feeding the radiance and the corresponding exposure time into the tone mapper. We use the classic volume rendering technique to project the output radiance, colors and densities into HDR and LDR images, while only the input LDR images are used as the supervision. We collect a new forward-facing HDR dataset to evaluate the proposed method. Experimental results on synthetic and real-world scenes validate that our method can not only accurately control the exposures of synthesized views but also render views with a high dynamic range.
引用
收藏
页码:18377 / 18387
页数:11
相关论文
共 50 条
  • [21] Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedra
    Kulhanek, Jonas
    Sattler, Torsten
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18412 - 18423
  • [22] CaSE-NeRF: Camera Settings Editing of Neural Radiance Fields
    Sun, Ciliang
    Li, Yuqi
    Li, Jiabao
    Wang, Chong
    Dai, Xinmiao
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 95 - 107
  • [23] NeRF-DA: Neural Radiance Fields Deblurring With Active Learning
    Hong, Sejun
    Kim, Eunwoo
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 261 - 265
  • [24] BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fields
    Wang, Peng
    Zhao, Lingzhe
    Ma, Ruijie
    Liu, Peidong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4170 - 4179
  • [25] FoV-NeRF: Foveated Neural Radiance Fields for Virtual Reality
    Deng, Nianchen
    He, Zhenyi
    Ye, Jiannan
    Duinkharjav, Budmonde
    Chakravarthula, Praneeth
    Yang, Xubo
    Sun, Qi
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (11) : 3854 - 3864
  • [26] Point-NeRF: Point-based Neural Radiance Fields
    Xu, Qiangeng
    Xu, Zexiang
    Philip, Julien
    Bi, Sai
    Shu, Zhixin
    Sunkavalli, Kalyan
    Neumann, Ulrich
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5428 - 5438
  • [27] NeRF-Art: Text-Driven Neural Radiance Fields Stylization
    Wang, Can
    Jiang, Ruixiang
    Chai, Menglei
    He, Mingming
    Chen, Dongdong
    Liao, Jing
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4983 - 4996
  • [28] Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields
    Isaac-Medina, Brian K. S.
    Willcocks, Chris G.
    Breckon, Toby P.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 66 - 75
  • [29] RS-NeRF: Neural Radiance Fields from Rolling Shutter Images
    Niu, Muyao
    Chen, Tong
    Zhan, Yifan
    Li, Zhuoxiao
    Ji, Xiang
    Zheng, Yinqiang
    COMPUTER VISION-ECCV 2024, PT XLVI, 2025, 15104 : 163 - 180
  • [30] MP-NeRF: Neural Radiance Fields for Dynamic Multi-person synthesis from Sparse Views
    Chao, X. J.
    Leung, H.
    COMPUTER GRAPHICS FORUM, 2022, 41 (08) : 317 - 325