Function MRI Representation Learning via Self-supervised Transformer for Automated Brain Disorder Analysis

被引:0
|
作者
Wang, Qianqian [1 ]
Qiao, Lishan [1 ]
Liu, Mingxia [2 ]
机构
[1] Liaocheng Univ, Sch Math Sci, Liaocheng 252000, Shandong, Peoples R China
[2] Univ North Carolina Chapel Hill, Dept Radiol & BRIC, Chapel Hill, NC 27599 USA
基金
中国国家自然科学基金;
关键词
Major depressive disorder; fMRI; Transformer; CLASSIFICATION; DEPRESSION;
D O I
10.1007/978-3-031-21014-3_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Major depressive disorder (MDD) is a prevalent mental health disorder whose neuropathophysiology remains unclear. Resting-state functional magnetic resonance imaging (rs-fMRI) has been used to capture abnormality or dysfunction functional connectivity networks for automated MDD detection. A functional connectivity network (FCN) of each subject derived from rs-fMRI data can be modeled as a graph consisting of nodes and edges. Graph neural networks (GNNs) play an important role in learning representations of graph-structured data by gradually updating and aggregating node features for brain disorder analysis. However, using one single GNN layer focuses on local graph structure around each node and stacking multiple GNN layers usually leads to the over-smoothing problem. To this end, we propose a transformer-based functional MRI representation learning (TRL) framework to encode global spatial information of FCNs for MDD diagnosis. Experimental results on 282 MDD patients and 251 healthy control (HC) subjects demonstrate that our method outperforms several competing methods in MDD identification based on rs-fMRI data. Besides, based on our learned fully connected graphs, we can detect discriminative functional connectivities in MDD vs. HC classification, providing potential fMRI biomarkers for MDD analysis.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 50 条
  • [41] Context Autoencoder for Self-supervised Representation Learning
    Xiaokang Chen
    Mingyu Ding
    Xiaodi Wang
    Ying Xin
    Shentong Mo
    Yunhao Wang
    Shumin Han
    Ping Luo
    Gang Zeng
    Jingdong Wang
    International Journal of Computer Vision, 2024, 132 : 208 - 223
  • [42] SelfDoc: Self-Supervised Document Representation Learning
    Li, Peizhao
    Gu, Jiuxiang
    Kuen, Jason
    Morariu, Vlad, I
    Zhao, Handong
    Jain, Rajiv
    Manjunatha, Varun
    Liu, Hongfu
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5648 - 5656
  • [43] Solving Inefficiency of Self-supervised Representation Learning
    Wang, Guangrun
    Wang, Keze
    Wang, Guangcong
    Torr, Philip H. S.
    Lin, Liang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9485 - 9495
  • [44] Self-supervised representation learning for trip recommendation
    Gao, Qiang
    Wang, Wei
    Zhang, Kunpeng
    Yang, Xin
    Miao, Congcong
    Li, Tianrui
    KNOWLEDGE-BASED SYSTEMS, 2022, 247
  • [45] Self-supervised Representation Learning for Astronomical Images
    Hayat, Md Abul
    Stein, George
    Harrington, Peter
    Lukic, Zarija
    Mustafa, Mustafa
    ASTROPHYSICAL JOURNAL LETTERS, 2021, 911 (02)
  • [46] Revisiting Self-Supervised Visual Representation Learning
    Kolesnikov, Alexander
    Zhai, Xiaohua
    Beyer, Lucas
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1920 - 1929
  • [47] MusicBERT: A Self-supervised Learning of Music Representation
    Zhu, Hongyuan
    Niu, Ye
    Fu, Di
    Wang, Hao
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3955 - 3963
  • [48] Self-Supervised Dense Visual Representation Learning
    Ozcelik, Timoteos Onur
    Gokberk, Berk
    Akarun, Lale
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [49] Self-supervised Representation Learning on Dynamic Graphs
    Tian, Sheng
    Wu, Ruofan
    Shi, Leilei
    Zhu, Liang
    Xiong, Tao
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1814 - 1823
  • [50] Self-Supervised Point Cloud Understanding via Mask Transformer and Contrastive Learning
    Wang, Di
    Yang, Zhi-Xin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (01) : 184 - 191