Bathymetric Surveying With Imaging Sonar Using Neural Volume Rendering

被引:0
|
作者
Xie, Yiping [1 ]
Troni, Giancarlo [2 ]
Bore, Nils [3 ]
Folkesson, John [1 ]
机构
[1] KTH Royal Inst Technol, Robot Percept & Learning Div, S-10044 Stockholm, Sweden
[2] Monterey Bay Aquarium Res Inst, Moss Landing, CA 95039 USA
[3] Ocean Infin, SE-42671 Vastra Frolunda, Sweden
来源
关键词
Sonar; Bathymetry; Image reconstruction; Three-dimensional displays; Rendering (computer graphics); Surveys; Encoding; Bathymetric reconstruction; deep learning methods; deep learning for visual perception; mapping; marine robotics; RECONSTRUCTION; SLAM;
D O I
10.1109/LRA.2024.3440843
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This research addresses the challenge of estimating bathymetry from imaging sonars where the state-of-the-art works have primarily relied on either supervised learning with ground-truth labels or surface rendering based on the Lambertian assumption. In this letter, we propose a novel, self-supervised framework based on volume rendering for reconstructing bathymetry using forward-looking sonar (FLS) data collected during standard surveys. We represent the seafloor as a neural heightmap encapsulated with a parametric multi-resolution hash encoding scheme and model the sonar measurements with a differentiable renderer using sonar volumetric rendering employed with hierarchical sampling techniques. Additionally, we model the horizontal and vertical beam patterns and estimate them jointly with the bathymetry. We evaluate the proposed method quantitatively on simulation and field data collected by remotely operated vehicles (ROVs) during low-altitude surveys. Results show that the proposed method outperforms the current state-of-the-art approaches that use imaging sonars for seabed mapping. We also demonstrate that the proposed approach can potentially be used to increase the resolution of a low-resolution prior map with FLS data from low-altitude surveys.
引用
收藏
页码:8146 / 8153
页数:8
相关论文
共 50 条
  • [41] NeUDF: Leaning Neural Unsigned Distance Fields with Volume Rendering
    Liu, Yu-Tao
    Wang, Li
    Yang, Jie
    Chen, Weikai
    Meng, Xiaoxu
    Yang, Bo
    Gao, Lin
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 237 - 247
  • [42] NeUDF: Learning Neural Unsigned Distance Fields With Volume Rendering
    Liu, Yu-Tao
    Wang, Li
    Yang, Jie
    Chen, Weikai
    Meng, Xiaoxu
    Yang, Bo
    Gao, Lin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (04) : 2364 - 2377
  • [43] Ray Reordering for Hardware-Accelerated Neural Volume Rendering
    Ding, Junran
    He, Yunxiang
    Yuan, Binzhe
    Yuan, Zhechen
    Zhou, Pingqiang
    Yu, Jingyi
    Lou, Xin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (11) : 11413 - 11422
  • [44] Edge preservation in volume rendering using splatting
    Huang, J
    Crawfis, R
    Stredney, D
    IEEE SYMPOSIUM ON VOLUME VISUALIZATION, 1998, : 63 - +
  • [45] Uncertainty visualization using HDR volume rendering
    Vijeth Dinesha
    Neeharika Adabala
    Vijay Natarajan
    The Visual Computer, 2012, 28 : 265 - 278
  • [46] Parallel volume rendering using the BSP model
    Xie, H
    Li, WQ
    PARALLEL AND DISTRIBUTED METHODS FOR IMAGE PROCESSING, 1997, 3166 : 274 - 279
  • [47] Using lights in a volume-oriented rendering
    Vyatkin, Sergey I.
    Romanyuk, Sergii A.
    Pavlov, Sergii V.
    Nykiforova, Larysa E.
    Kolimoldayev, Maksat
    Wojcik, Waldemar
    Gurov, Egor
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH ENERGY PHYSICS EXPERIMENTS 2017, 2017, 10445
  • [48] Incremental volume rendering using hierarchical compression
    Haley, MB
    Blake, EH
    COMPUTER GRAPHICS FORUM, 1996, 15 (03) : C45 - C55
  • [49] Estimation of stenotic degree using volume rendering
    Heath, DG
    Ebert, DS
    Kuszyk, BS
    Zhang, L
    Shaw, CD
    Fishman, EK
    RADIOLOGY, 1997, 205 : 1405 - 1405
  • [50] Uncertainty visualization using HDR volume rendering
    Dinesha, Vijeth
    Adabala, Neeharika
    Natarajan, Vijay
    VISUAL COMPUTER, 2012, 28 (03): : 265 - 278