EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries Using Gaussian Splatting

被引:0
|
作者
Wang, Kailing [1 ]
Yang, Chen [1 ]
Wang, Yuehao [2 ]
Li, Sikuang [1 ]
Wang, Yan [3 ]
Dou, Qi [2 ]
Yang, Xiaokang [1 ]
Shen, Wei [1 ]
机构
[1] Shanghai Jiao Tong Univ, AI Inst, MoE Key Lab Artificial Intelligence, Shanghai, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Ma Liu Shui, Hong Kong, Peoples R China
[3] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Endoscopic surgeries; SLAM; Real-time rendering; Tissue reconstruction; SLAM;
D O I
10.1007/978-3-031-72089-5_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications in endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates simplified Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments and surveys of surgeons show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://loping151.github.io/endogslam.
引用
收藏
页码:219 / 229
页数:11
相关论文
共 50 条
  • [41] Real-time Dense Visual Tracking under Large Lighting Variations
    Meilland, Maxime
    Comport, Andrew Ian
    Rives, Patrick
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2011, 2011,
  • [42] TOWARD A REAL-TIME TRACKING OF DENSE POINT-SAMPLED GEOMETRY
    Destelle, F.
    Roudet, C.
    Neveu, M.
    Dipanda, A.
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 381 - 384
  • [43] Toward a real-time tracking of dense point-sampled geometry
    LE2I Laboratory, UMR-CNRS 5158, University of Burgundy, France
    Proc. Int. Conf. Image Process. ICIP, 2012, (381-384):
  • [44] DART: dense articulated real-time tracking with consumer depth cameras
    Tanner Schmidt
    Richard Newcombe
    Dieter Fox
    Autonomous Robots, 2015, 39 : 239 - 258
  • [45] Onboard Real-Time Dense Reconstruction in Large Terrain Scene Using Embedded UAV Platform
    Lai, Zhengchao
    Liu, Fei
    Guo, Shangwei
    Meng, Xiantong
    Han, Shaokun
    Li, Wenhao
    REMOTE SENSING, 2021, 13 (14)
  • [46] Real-Time Volumetric Reconstruction and Tracking of Hands in a Desktop Environment
    John, Christoph
    Schwanecke, Ulrich
    Regenbrecht, Holger
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PROCEEDINGS, 2009, 5702 : 1053 - +
  • [47] SynGauss: Real-Time 3D Gaussian Splatting for Audio-Driven Talking Head Synthesis
    Zhou, Zhanyi
    Feng, Quandong
    Li, Hongjun
    IEEE ACCESS, 2025, 13 : 42167 - 42177
  • [48] Gaussian-Staple for Robust Visual Object Real-Time Tracking
    Chen, Si-Bao
    Ding, Chuan-Yong
    Luo, Bin
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2018, 2018, 10989 : 370 - 381
  • [49] DynMF: Neural Motion Factorization for Real-Time Dynamic View Synthesis with 3D Gaussian Splatting
    Krimenoglou, Agelos
    Lei, Jiahui
    Daniilidis, Kostas
    COMPUTER VISION - ECCV 2024, PT LXXIX, 2025, 15137 : 252 - 269
  • [50] Real-time Hand Tracking Using Kinect
    Xi, Chenxuan
    Chen, Jianxin
    Zhao, Chenxue
    Pei, Qicheng
    Liu, Lizheng
    2018 2ND INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (ICDSP 2018), 2018, : 37 - 42