Multi-User Surgical Navigation Platform Based on Mixed Reality

被引:0
|
作者
Chiou, Shin-Yan [1 ,2 ,3 ]
Liu, Tao-Ming [4 ]
Liu, Hao-Li [4 ,5 ]
机构
[1] Chang Gung Univ, Coll Engn, Dept Elect Engn, Taoyuan 33302, Taiwan
[2] Keelung Chang Gung Mem Hosp, Dept Neurosurg, Keelung 20401, Taiwan
[3] Dept Tradit Chinese Med, Div Acupuncture & Moxibust, Linkou Chang Gung Mem, Taoyuan 33302, Taiwan
[4] Natl Taiwan Univ, Dept Elect Engn, Taipei 106319, Taiwan
[5] Natl Taiwan Univ, Grad Inst Biomed Elect & Bioinformat, Taipei 10617, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Navigation; Three-dimensional displays; Real-time systems; Mixed reality; Ultrasonic imaging; Collaboration; Accuracy; Optical imaging; Visualization; Mixed reality navigation; surgical guidance system; 3D ultrasound visualization; multi-user collaboration; HoloLens; 2; AUGMENTED REALITY; SURGERY;
D O I
10.1109/ACCESS.2024.3486151
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extended Reality (XR) technology enables visualization of patient data during surgery, with Augmented Reality (AR) systems offering 2D or 3D navigation. However, current systems face limitations such as lack of depth in 2D navigation, restricted single-user functionality in 3D navigation, and limited interoperability between tracking markers and navigation platforms. Additionally, users cannot interact with virtual objects, reducing operational efficiency and intuitiveness. This study addresses these issues by proposing a multi-user Mixed Reality (MR) guidance platform that provides interactive, real-time feedback and enhances collaboration. The platform maps 3D medical models onto real-world objects using 2D marker calibration, supporting focused ultrasound for transcranial brain therapy. Integration with BrainLab and HoloLens 2 achieved a single-user positioning accuracy of 0.576 +/- 0.294mm, with multi-user alignment errors averaging 2.718 +/- 1.335mm. The system maintained a frame rate of 50-60 FPS, demonstrating robust performance and precision.
引用
收藏
页码:162522 / 162535
页数:14
相关论文
共 50 条
  • [21] Augmented reality-based BIM multi-user collaboration system
    Sun Heng
    Qiao Xiuquan
    The Journal of China Universities of Posts and Telecommunications, 2022, 29 (01) : 71 - 80
  • [22] Networked Architectures for Localization-Based Multi-User Augmented Reality
    Chen, Jiasi
    Ramakrishnan, K. K.
    Dhakazl, Aditya
    Ran, Xukan
    IEEE COMMUNICATIONS MAGAZINE, 2023, 61 (12) : 104 - 110
  • [23] Reimagining Historical Exploration: Multi-User Mixed Reality Systems for Cultural Heritage Sites
    Chrysanthakopoulou, Agapi
    Chrysikopoulos, Theofilos
    Arvanitis, Gerasimos
    Moustakas, Konstantinos
    APPLIED SCIENCES-BASEL, 2025, 15 (05):
  • [24] Drawing Sound in MR Space: A Multi-User Audiovisual Experience in Mixed Reality Space
    Nakagawa, Ryu
    Komatsubara, Ryo
    Ota, Taku
    Mitsumori, Takahisa
    PROCEEDINGS OF THE VIRTUAL REALITY INTERNATIONAL CONFERENCE - LAVAL VIRTUAL (ACM VRIC 2018), 2018,
  • [25] ARCollab: Towards Multi-User Interactive Cardiovascular Surgical Planning in Mobile Augmented Reality
    Mehta, Pratham Darrpan
    Karanth, Harsha Dinesh
    Yang, Haoyang
    Slesnick, Timothy C.
    Shaw, Fawwaz
    Chau, Duen Horng
    EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,
  • [26] An Edge Cloud Based Coordination Platform for Multi-user AR Applications
    Sonkoly, Balazs
    Nagy, Balint Gyorgy
    Doka, Janos
    Kecskes-Solymosi, Zsofia
    Czentye, Janos
    Formanek, Bence
    Jocha, David
    Gero, Balazs Peter
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2024, 32 (02)
  • [27] NotreDAM, a Multi-user, Web Based Digital Asset Management Platform
    Agelli, Maurizio
    Clemente, Maria Laura
    Del Rio, Mauro
    Ghironi, Daniela
    Murru, Orlando
    Solinas, Fabrizio
    RESEARCH AND ADVANCED TECHNOLOGY FOR DIGITAL LIBRARIES, TPDL 2011, 2011, 6966 : 453 - 456
  • [28] An Edge Cloud Based Coordination Platform for Multi-user AR Applications
    Balázs Sonkoly
    Bálint György Nagy
    János Dóka
    Zsófia Kecskés-Solymosi
    János Czentye
    Bence Formanek
    Dávid Jocha
    Balázs Péter Gerő
    Journal of Network and Systems Management, 2024, 32
  • [29] ICA based blind multi-user detection method in CDMA navigation system
    Shang Junna
    Zhao Zhijin
    Wang Xiaorong
    SECOND INTERNATIONAL CONFERENCE ON SPACE INFORMATION TECHNOLOGY, PTS 1-3, 2007, 6795
  • [30] Surgical Navigation System for Pedicle Screw Placement Based on Mixed Reality
    Hwang, Seokbin
    Lee, Suk-joong
    Kim, Sungmin
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2023, 21 (12) : 3983 - 3993