Towards Accurate Microstructure Estimation via 3D Hybrid Graph Transformer

被引:0
|
作者
Yang, Junqing [1 ]
Jiang, Haotian [2 ]
Tassew, Tewodros [1 ]
Sun, Peng [1 ]
Ma, Jiquan [2 ]
Xia, Yong [1 ]
Yap, Pew-Thian [3 ,4 ]
Chen, Geng [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Natl Engn Lab Integrated Aerosp Ground Ocean Big, Xian, Peoples R China
[2] Heilongjiang Univ, Sch Comp Sci & Technol, Harbin, Peoples R China
[3] Univ N Carolina, Dept Radiol, Chapel Hill, NC USA
[4] Univ N Carolina, Biomed Res Imaging Ctr, Chapel Hill, NC USA
基金
中国国家自然科学基金; 美国国家卫生研究院;
关键词
Microstructure Imaging; Graph Neural Network; Transformer; 3D Spatial Domain; DIFFUSION;
D O I
10.1007/978-3-031-43993-3_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has drawn increasing attention in microstructure estimation with undersampled diffusion MRI (dMRI) data. A representative method is the hybrid graph transformer (HGT), which achieves promising performance by integrating q-space graph learning and x-space transformer learning into a unified framework. However, this method overlooks the 3D spatial information as it relies on training with 2D slices. To address this limitation, we propose 3D hybrid graph transformer (3D-HGT), an advanced microstructure estimation model capable of making full use of 3D spatial information and angular information. To tackle the large computation burden associated with 3D x-space learning, we propose an efficient q-space learning model based on simplified graph neural networks. Furthermore, we propose a 3D x-space learning module based on the transformer. Extensive experiments on data from the human connectome project show that our 3D-HGT outperforms state-of-the-art methods, including HGT, in both quantitative and qualitative evaluations.
引用
收藏
页码:25 / 34
页数:10
相关论文
共 50 条
  • [31] 3D VIDEO FRAME INTERPOLATION VIA ADAPTIVE HYBRID MOTION ESTIMATION AND COMPENSATION
    Yang, Xiaohui
    Feng, Zhiquan
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1691 - 1695
  • [32] 3D hand pose and mesh estimation via a generic Topology-aware Transformer model
    Yu, Shaoqi
    Wang, Yintong
    Chen, Lili
    Zhang, Xiaolin
    Li, Jiamao
    FRONTIERS IN NEUROROBOTICS, 2024, 18
  • [33] Efficient 3D porous microstructure reconstruction via Gaussian random field and hybrid optimization
    Jiang, Z.
    Chen, W.
    Burkhart, C.
    JOURNAL OF MICROSCOPY, 2013, 252 (02) : 135 - 148
  • [34] ACCURATE 3D SHAPE ESTIMATION BASED ON COMBINATORIAL OPTIMIZATION
    Shim, Seong-O
    Choi, Tae-Sun
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 3777 - 3780
  • [35] Efficient estimation of accurate maximum likelihood maps in 3D
    Grisetti, Giorgio
    Grzonka, Slawomir
    Stachniss, Cyrill
    Pfaff, Patrick
    Burgard, Wolfram
    2007 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-9, 2007, : 3478 - 3484
  • [36] Quick and accurate estimation of human 3D hand posture
    Hoshino, Kiyoshi
    Tomida, Motomasa
    INTELLIGENT SERVICE ROBOTICS, 2010, 3 (01) : 11 - 19
  • [37] Accurate Localization and Pose Estimation for Large 3D Models
    Svarm, Linus
    Enqvist, Olof
    Oskarsson, Magnus
    Kahl, Fredrik
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 532 - 539
  • [38] Quick and accurate estimation of human 3D hand posture
    Kiyoshi Hoshino
    Motomasa Tomida
    Intelligent Service Robotics, 2010, 3 : 11 - 19
  • [39] Towards Accurate and Compact Architectures via Neural Architecture Transformer
    Guo, Yong
    Zheng, Yin
    Tan, Mingkui
    Chen, Qi
    Li, Zhipeng
    Chen, Jian
    Zhao, Peilin
    Huang, Junzhou
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6501 - 6516
  • [40] HyNet: 3D Segmentation Using Hybrid Graph Networks
    Shakibajahromi, Bahareh
    Shayestehmanesh, Saeed
    Schwartz, Daniel
    Shokoufandeh, Ali
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 805 - 814