Multi-User Surgical Navigation Platform Based on Mixed Reality

被引：0
|
作者：
Chiou, Shin-Yan [1 ,2 ,3 ]
Liu, Tao-Ming [4 ]
Liu, Hao-Li [4 ,5 ]
机构：
[1] Chang Gung Univ, Coll Engn, Dept Elect Engn, Taoyuan 33302, Taiwan
[2] Keelung Chang Gung Mem Hosp, Dept Neurosurg, Keelung 20401, Taiwan
[3] Dept Tradit Chinese Med, Div Acupuncture & Moxibust, Linkou Chang Gung Mem, Taoyuan 33302, Taiwan
[4] Natl Taiwan Univ, Dept Elect Engn, Taipei 106319, Taiwan
[5] Natl Taiwan Univ, Grad Inst Biomed Elect & Bioinformat, Taipei 10617, Taiwan
来源：
IEEE ACCESS | 2024年 / 12卷
关键词：
Surgery; Navigation; Three-dimensional displays; Real-time systems; Mixed reality; Ultrasonic imaging; Collaboration; Accuracy; Optical imaging; Visualization; Mixed reality navigation; surgical guidance system; 3D ultrasound visualization; multi-user collaboration; HoloLens; 2; AUGMENTED REALITY; SURGERY;
D O I：
10.1109/ACCESS.2024.3486151
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Extended Reality (XR) technology enables visualization of patient data during surgery, with Augmented Reality (AR) systems offering 2D or 3D navigation. However, current systems face limitations such as lack of depth in 2D navigation, restricted single-user functionality in 3D navigation, and limited interoperability between tracking markers and navigation platforms. Additionally, users cannot interact with virtual objects, reducing operational efficiency and intuitiveness. This study addresses these issues by proposing a multi-user Mixed Reality (MR) guidance platform that provides interactive, real-time feedback and enhances collaboration. The platform maps 3D medical models onto real-world objects using 2D marker calibration, supporting focused ultrasound for transcranial brain therapy. Integration with BrainLab and HoloLens 2 achieved a single-user positioning accuracy of 0.576 +/- 0.294mm, with multi-user alignment errors averaging 2.718 +/- 1.335mm. The system maintained a frame rate of 50-60 FPS, demonstrating robust performance and precision.
引用
收藏
页码：162522 / 162535
页数：14
相关论文
共 50 条
  • [1] MuVR: A Multi-user Virtual Reality Platform
    Thomas, Jerald
    Bashyal, Raghav
    Goldstein, Samantha
    Suma, Evan
    2014 IEEE VIRTUAL REALITY (VR), 2014, : 115 - 116
  • [2] An Overview of Group Navigation in Multi-User Virtual Reality
    Weissker, Tim
    Bimberg, Pauline
    Froehlich, Bernd
    2021 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2021), 2021, : 363 - 369
  • [3] Performance Evaluation of a Multi-User Virtual Reality Platform
    Parthasarathy, Venkatakrishnan
    Simiscuka, Anderson Augusto
    O'Connor, Noel
    Muntean, Gabriel-Miro
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 934 - 939
  • [4] Multi-User Networked Framework for Virtual Reality Platform
    Rai, Ankush
    Kannan, R. Jagadeesh.
    Ramanathan, Sakkaravarthi
    2017 14TH IEEE ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2017, : 584 - 585
  • [5] Multi-User Drone Flight Training in Mixed Reality
    Go, Yong-Guk
    Kang, Ho-San
    Lee, Jong-Won
    Yu, Mun-Su
    Choi, Soo-Mi
    ELECTRONICS, 2021, 10 (20)
  • [6] MRMAC: Mixed Reality Multi-user Asymmetric Collaboration
    Zaman, Faisal
    Anslow, Craig
    Chalmers, Andrew
    Rhee, Taehyun
    2023 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, ISMAR, 2023, : 591 - 600
  • [7] BoatAR: A Multi-user Augmented-Reality Platform for Boat
    Liu, Yishuo
    Zhang, Yichuan
    Zuo, Shiliang
    Fu, Wai-Tat
    24TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2018), 2018,
  • [8] Multi-user layer in the EVE distributed virtual reality platform
    Bouras, C
    Psaltoulis, D
    Psaroudis, C
    Tsiatsos, T
    23RD INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS, 2003, : 602 - 607
  • [9] [DC] Improving Multi-User Interaction for Mixed Reality Telecollaboration
    Zaman, Faisal
    2022 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2022), 2022, : 940 - 941
  • [10] Distributed virtual reality: building a multi-user layer for the EVE Platform
    Bouras, C
    Tsiatsos, T
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2004, 27 (02) : 91 - 111
12345