Towards Accurate Microstructure Estimation via 3D Hybrid Graph Transformer

被引:0
|
作者
Yang, Junqing [1 ]
Jiang, Haotian [2 ]
Tassew, Tewodros [1 ]
Sun, Peng [1 ]
Ma, Jiquan [2 ]
Xia, Yong [1 ]
Yap, Pew-Thian [3 ,4 ]
Chen, Geng [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Natl Engn Lab Integrated Aerosp Ground Ocean Big, Xian, Peoples R China
[2] Heilongjiang Univ, Sch Comp Sci & Technol, Harbin, Peoples R China
[3] Univ N Carolina, Dept Radiol, Chapel Hill, NC USA
[4] Univ N Carolina, Biomed Res Imaging Ctr, Chapel Hill, NC USA
基金
中国国家自然科学基金; 美国国家卫生研究院;
关键词
Microstructure Imaging; Graph Neural Network; Transformer; 3D Spatial Domain; DIFFUSION;
D O I
10.1007/978-3-031-43993-3_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has drawn increasing attention in microstructure estimation with undersampled diffusion MRI (dMRI) data. A representative method is the hybrid graph transformer (HGT), which achieves promising performance by integrating q-space graph learning and x-space transformer learning into a unified framework. However, this method overlooks the 3D spatial information as it relies on training with 2D slices. To address this limitation, we propose 3D hybrid graph transformer (3D-HGT), an advanced microstructure estimation model capable of making full use of 3D spatial information and angular information. To tackle the large computation burden associated with 3D x-space learning, we propose an efficient q-space learning model based on simplified graph neural networks. Furthermore, we propose a 3D x-space learning module based on the transformer. Extensive experiments on data from the human connectome project show that our 3D-HGT outperforms state-of-the-art methods, including HGT, in both quantitative and qualitative evaluations.
引用
收藏
页码:25 / 34
页数:10
相关论文
共 50 条
  • [1] GraFormer: Graph-oriented Transformer for 3D Pose Estimation
    Zhao, Weixi
    Wang, Weiqiang
    Tian, Yunjie
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20406 - 20415
  • [2] DGFormer: Dynamic graph transformer for 3D human pose estimation
    Chen, Zhangmeng
    Dai, Ju
    Bai, Junxuan
    Pan, Junjun
    PATTERN RECOGNITION, 2024, 152
  • [3] HandDAGT: A Denoising Adaptive Graph Transformer for 3D Hand Pose Estimation
    Cheng, Wencan
    Kim, Eunji
    Ko, Jong Hwan
    COMPUTER VISION - ECCV 2024, PT LXXXVIII, 2025, 15146 : 35 - 52
  • [4] Hybrid Graph Transformer for Tissue Microstructure Estimation with Undersampled Diffusion MRI Data
    Chen, Geng
    Jiang, Haotian
    Liu, Jiannan
    Ma, Jiquan
    Cui, Hui
    Xia, Yong
    Yap, Pew-Thian
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT I, 2022, 13431 : 113 - 122
  • [5] Multi-hop graph transformer network for 3D human pose estimation
    Islam, Zaedul
    Ben Hamza, A.
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 101
  • [6] SCGFormer: Semantic Chebyshev Graph Convolution Transformer for 3D Human Pose Estimation
    Liang, Jiayao
    Yin, Mengxiao
    APPLIED SCIENCES-BASEL, 2024, 14 (04):
  • [7] Multi-hop Graph Transformer Network for 3D Human Pose Estimation
    Islam, Zaedul
    Hamza, A. Ben
    arXiv,
  • [8] GRAPHRPE: RELATIVE POSITION ENCODING GRAPH TRANSFORMER FOR 3D HUMAN POSE ESTIMATION
    Zou, Junjie
    Shao, Ming
    Xia, Siyu
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 895 - 899
  • [9] Learning accurate monocular 3D voxel representation via bilateral voxel transformer
    Cheng, Tianheng
    Jiang, Haoyi
    Chen, Shaoyu
    Liao, Bencheng
    Zhang, Qian
    Liu, Wenyu
    Wang, Xinggang
    IMAGE AND VISION COMPUTING, 2024, 150
  • [10] Dynamic graph transformer for 3D object detection
    Ren, Siyuan
    Pan, Xiao
    Zhao, Wenjie
    Nie, Binling
    Han, Bo
    KNOWLEDGE-BASED SYSTEMS, 2023, 259