Towards Accurate Microstructure Estimation via 3D Hybrid Graph Transformer

被引:0
|
作者
Yang, Junqing [1 ]
Jiang, Haotian [2 ]
Tassew, Tewodros [1 ]
Sun, Peng [1 ]
Ma, Jiquan [2 ]
Xia, Yong [1 ]
Yap, Pew-Thian [3 ,4 ]
Chen, Geng [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Natl Engn Lab Integrated Aerosp Ground Ocean Big, Xian, Peoples R China
[2] Heilongjiang Univ, Sch Comp Sci & Technol, Harbin, Peoples R China
[3] Univ N Carolina, Dept Radiol, Chapel Hill, NC USA
[4] Univ N Carolina, Biomed Res Imaging Ctr, Chapel Hill, NC USA
基金
中国国家自然科学基金; 美国国家卫生研究院;
关键词
Microstructure Imaging; Graph Neural Network; Transformer; 3D Spatial Domain; DIFFUSION;
D O I
10.1007/978-3-031-43993-3_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has drawn increasing attention in microstructure estimation with undersampled diffusion MRI (dMRI) data. A representative method is the hybrid graph transformer (HGT), which achieves promising performance by integrating q-space graph learning and x-space transformer learning into a unified framework. However, this method overlooks the 3D spatial information as it relies on training with 2D slices. To address this limitation, we propose 3D hybrid graph transformer (3D-HGT), an advanced microstructure estimation model capable of making full use of 3D spatial information and angular information. To tackle the large computation burden associated with 3D x-space learning, we propose an efficient q-space learning model based on simplified graph neural networks. Furthermore, we propose a 3D x-space learning module based on the transformer. Extensive experiments on data from the human connectome project show that our 3D-HGT outperforms state-of-the-art methods, including HGT, in both quantitative and qualitative evaluations.
引用
收藏
页码:25 / 34
页数:10
相关论文
共 50 条
  • [21] MeT: A Graph Transformer for Semantic Segmentation of 3D Meshes
    Department of Computer Engineering, University of Catania, Italy
    不详
    arXiv, 1600,
  • [22] PoseGTAC: Graph Transformer Encoder-Decoder with Atrous Convolution for 3D Human Pose Estimation
    Zhu, Yiran
    Xu, Xing
    Shen, Fumin
    Ji, Yanli
    Gao, Lianli
    Shen, Heng Tao
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1359 - 1365
  • [23] Towards Accurate 3D Human Reconstruction: Segmentation-Based Supervision With Uncertainty Estimation
    Yu, Han
    Wu, Jingyi
    Wang, Ziming
    Ni, Wei
    Song, Liang
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 1036 - 1040
  • [24] Accurate Scale Factor Estimation in 3D Reconstruction
    Lourakis, Manolis
    Zabulis, Xenophon
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PT I, 2013, 8047 : 498 - 506
  • [25] A HYBRID APPROACH TO 3D POROUS MICROSTRUCTURE RECONSTRUCTION VIA GAUSSIAN RANDOM FIELD
    Jiang, Zhen
    Chen, Wei
    Burkhart, Craig
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE 2012, VOL 2, PTS A AND B, 2012, : 1033 - +
  • [26] Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation
    Moon, Gyeongsik
    Choi, Hongsuk
    Lee, Kyoung Mu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 2307 - 2316
  • [27] Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation
    Hampali, Shreyas
    Sarkar, Sayan Deb
    Rad, Mahdi
    Lepetit, Vincent
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11080 - 11090
  • [28] Graph Transformer for 3D point clouds classification and semantic segmentation
    Zhou, Wei
    Wang, Qian
    Jin, Weiwei
    Shi, Xinzhe
    He, Ying
    COMPUTERS & GRAPHICS-UK, 2024, 124
  • [29] AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation
    Ohkawa, Takehiko
    He, Kun
    Sener, Fadime
    Hodan, Tomas
    Tran, Luan
    Keskin, Cem
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12999 - 13008
  • [30] Using stereo geometry towards accurate 3D reconstruction
    Wang, Z.
    Boufama, B.
    2009 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY, 2009, : 132 - 138