WaterHE-NeRF: Water-ray matching neural radiance fields for underwater scene reconstruction

被引:0
|
作者
Zhou, Jingchun [1 ]
Liang, Tianyu [1 ]
Zhang, Dehuan [1 ]
Liu, Siyuan [2 ]
Wang, Junsheng [1 ]
Wu, Edmond Q. [3 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Liaoning, Peoples R China
[2] Dalian Maritime Univ, Dept Marine Engn, Dalian 116026, Liaoning, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
关键词
Underwater image; Image enhancement; Neural radiance field; Image fusion; IMAGE-ENHANCEMENT;
D O I
10.1016/j.inffus.2024.102770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Field (NeRF) technology demonstrates immense potential in novel viewpoint synthesis tasks due to its physics-based volumetric rendering process, which is particularly promising in underwater scenes. However, existing underwater NeRF methods face challenges in handling light attenuation caused by the water medium and the lack of real Ground Truth (GT) supervision. To address these issues, we propose WaterHE-NeRF, a novel approach incorporating a water-ray matching field developed based on Retinex theory. This field precisely encodes color, density, and illuminance attenuation in three-dimensional space. WaterHENeRF employs an illuminance attenuation mechanism to generate degraded and clear multi-view images, optimizing image restoration by combining reconstruction loss with Wasserstein distance. Furthermore, using histogram equalization (HE) as pseudo-GT, WaterHE-NeRF enhances the network's accuracy in preserving original details and color distribution. Extensive experiments on real underwater and synthetic datasets validate the effectiveness of WaterHE-NeRF.
引用
收藏
页数:17
相关论文
共 26 条
  • [1] Adapting Neural Radiance Fields (NeRF) to the 3D Scene Reconstruction Problem Under Dynamic Illumination Conditions
    Savin, V.
    Kolodiazhna, O.
    CYBERNETICS AND SYSTEMS ANALYSIS, 2023, 59 (06) : 910 - 918
  • [2] Adapting Neural Radiance Fields (NeRF) to the 3D Scene Reconstruction Problem Under Dynamic Illumination Conditions
    V. Savin
    O. Kolodiazhna
    Cybernetics and Systems Analysis, 2023, 59 : 910 - 918
  • [3] CL-NeRF: Continual Learning of Neural Radiance Fields for Evolving Scene Representation
    Wu, Xiuzhe
    Dai, Peng
    Deng, Weipeng
    Chen, Handi
    Wu, Yang
    Cao, Yan-Pei
    Shan, Ying
    Qi, Xiaojuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [4] Tomato-Nerf: Advancing Tomato Model Reconstruction With Improved Neural Radiance Fields
    Zheng, Xiajun
    Ai, Xinyi
    Qin, Hao
    Rong, Jiacheng
    Zhang, Zhiqin
    Yang, Yan
    Yuan, Ting
    Li, Wei
    IEEE ACCESS, 2024, 12 : 184206 - 184215
  • [5] H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motion
    Xu, Hongyi
    Alldieck, Thiemo
    Sminchisescu, Cristian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] EGRA-NeRF: Edge-Guided Ray Allocation for Neural Radiance Fields
    Gai Z.
    Liu Z.
    Tan M.
    Ding J.
    Yu J.
    Tong M.
    Yuan J.
    Image and Vision Computing, 2023, 134
  • [7] NeRF-OR: neural radiance fields for operating room scene reconstruction from sparse-view RGB-D videos
    Gerats, Beerend G. A.
    Wolterink, Jelmer M.
    Broeders, Ivo A. M. J.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2025, 20 (01) : 147 - 156
  • [8] UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene
    Chen, Yaosen
    Yuan, Qi
    Li, Zhiqiang
    Liu, Yuegen
    Wang, Wei
    Xie, Chaoping
    Wen, Xuming
    Yu, Qien
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2025, 31 (04) : 2045 - 2057
  • [9] CP-NeRF: Conditionally Parameterized Neural Radiance Fields for Cross-scene Novel View Synthesis
    He, Hao
    Liang, Yixun
    Xiao, Shishi
    Chen, Jierun
    Chen, Yingcong
    COMPUTER GRAPHICS FORUM, 2023, 42 (07)
  • [10] SAMSNeRF: Segment Anything Model (SAM) Guides Dynamic Surgical Scene Reconstruction by Neural Radiance Field (NeRF)
    Lou, Ange
    Li, Yamin
    Yao, Xing
    Zhang, Yike
    Noble, Jack
    IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, MEDICAL IMAGING 2024, 2024, 12928