Multi-User Surgical Navigation Platform Based on Mixed Reality

被引:0
|
作者
Chiou, Shin-Yan [1 ,2 ,3 ]
Liu, Tao-Ming [4 ]
Liu, Hao-Li [4 ,5 ]
机构
[1] Chang Gung Univ, Coll Engn, Dept Elect Engn, Taoyuan 33302, Taiwan
[2] Keelung Chang Gung Mem Hosp, Dept Neurosurg, Keelung 20401, Taiwan
[3] Dept Tradit Chinese Med, Div Acupuncture & Moxibust, Linkou Chang Gung Mem, Taoyuan 33302, Taiwan
[4] Natl Taiwan Univ, Dept Elect Engn, Taipei 106319, Taiwan
[5] Natl Taiwan Univ, Grad Inst Biomed Elect & Bioinformat, Taipei 10617, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Navigation; Three-dimensional displays; Real-time systems; Mixed reality; Ultrasonic imaging; Collaboration; Accuracy; Optical imaging; Visualization; Mixed reality navigation; surgical guidance system; 3D ultrasound visualization; multi-user collaboration; HoloLens; 2; AUGMENTED REALITY; SURGERY;
D O I
10.1109/ACCESS.2024.3486151
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extended Reality (XR) technology enables visualization of patient data during surgery, with Augmented Reality (AR) systems offering 2D or 3D navigation. However, current systems face limitations such as lack of depth in 2D navigation, restricted single-user functionality in 3D navigation, and limited interoperability between tracking markers and navigation platforms. Additionally, users cannot interact with virtual objects, reducing operational efficiency and intuitiveness. This study addresses these issues by proposing a multi-user Mixed Reality (MR) guidance platform that provides interactive, real-time feedback and enhances collaboration. The platform maps 3D medical models onto real-world objects using 2D marker calibration, supporting focused ultrasound for transcranial brain therapy. Integration with BrainLab and HoloLens 2 achieved a single-user positioning accuracy of 0.576 +/- 0.294mm, with multi-user alignment errors averaging 2.718 +/- 1.335mm. The system maintained a frame rate of 50-60 FPS, demonstrating robust performance and precision.
引用
收藏
页码:162522 / 162535
页数:14
相关论文
共 50 条
  • [41] PROMAR: Practical Reference Object-based Multi-user Augmented Reality
    Li, Tengpeng
    Nam Son Nguyen
    Zhang, Xiaoqian
    Wang, Teng
    Sheng, Bo
    IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2020, : 1359 - 1368
  • [42] A general collaborative platform for mobile multi-user applications
    Lim, Mingyu
    Nijdam, Niels
    Magnenat-Thalmann, Nadia
    2008 IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION, PROCEEDINGS, 2008, : 1346 - 1353
  • [43] Grid computing on massively multi-user online platform
    Yu, Y. C. Allen
    Law, K. L. Eddie
    PROCEEDINGS - 16TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS, VOLS 1-3, 2007, : 135 - 140
  • [44] Collaborative Multi-User Task Allocation in Social-Based Crowdsensing Platform
    Lin, Kun-Yu
    Hu, Chih-Lin
    Mir, Mohd Yaseen
    Huang, Sheng-Zhi
    Chen, Yung-Hui
    Hui, Lin
    INTERNET TECHNOLOGY LETTERS, 2024,
  • [45] A Multi-User Multi-Robot Collaboration through Augmented Reality
    Martins, Joao G.
    Costa, Gabriel M.
    Petry, Marcelo R.
    Costa, Paulo
    Moreira, Antonio Paulo
    2024 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC, 2024, : 144 - 150
  • [46] Multi-user Multi-platform xR Collaboration: System and Evaluation
    Tuemler, Johannes
    Toprak, Alp
    Yan, Baixuan
    VIRTUAL, AUGMENTED AND MIXED REALITY: DESIGN AND DEVELOPMENT, PT I, 2022, 13317 : 74 - 93
  • [47] Multi-user Resource Allocation for Low Latency Communications based on Mixed Numerology
    Marijanovic, Ljiljana
    Schwarz, Stefan
    Rupp, Markus
    2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL), 2019,
  • [48] Multimodal Multi-User Mixed Reality Human-Robot Interface for Remote Operations in Hazardous Environments
    Szczurek, Krzysztof Adam
    Prades, Raul Marin
    Matheson, Eloise
    Rodriguez-Nogueira, Jose
    Castro, Mario Di
    IEEE ACCESS, 2023, 11 : 17305 - 17333
  • [49] An integrated augmented reality surgical navigation platform using multi-modality imaging for guidance
    Chan, Harley H. L.
    Haerle, Stephan K.
    Daly, Michael J.
    Zheng, Jinzi
    Philp, Lauren
    Ferrari, Marco
    Douglas, Catriona M.
    Irish, Jonathan C.
    PLOS ONE, 2021, 16 (04):
  • [50] ViewR: Architectural-Scale Multi-User Mixed Reality With Mobile Head-Mounted Displays
    Schier, Florian
    Zeidler, Daniel
    Chandran, Krishnan
    Yu, Zhongyuan
    Mcginity, Matthew
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 5609 - 5622