Function MRI Representation Learning via Self-supervised Transformer for Automated Brain Disorder Analysis

被引:0
|
作者
Wang, Qianqian [1 ]
Qiao, Lishan [1 ]
Liu, Mingxia [2 ]
机构
[1] Liaocheng Univ, Sch Math Sci, Liaocheng 252000, Shandong, Peoples R China
[2] Univ North Carolina Chapel Hill, Dept Radiol & BRIC, Chapel Hill, NC 27599 USA
基金
中国国家自然科学基金;
关键词
Major depressive disorder; fMRI; Transformer; CLASSIFICATION; DEPRESSION;
D O I
10.1007/978-3-031-21014-3_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Major depressive disorder (MDD) is a prevalent mental health disorder whose neuropathophysiology remains unclear. Resting-state functional magnetic resonance imaging (rs-fMRI) has been used to capture abnormality or dysfunction functional connectivity networks for automated MDD detection. A functional connectivity network (FCN) of each subject derived from rs-fMRI data can be modeled as a graph consisting of nodes and edges. Graph neural networks (GNNs) play an important role in learning representations of graph-structured data by gradually updating and aggregating node features for brain disorder analysis. However, using one single GNN layer focuses on local graph structure around each node and stacking multiple GNN layers usually leads to the over-smoothing problem. To this end, we propose a transformer-based functional MRI representation learning (TRL) framework to encode global spatial information of FCNs for MDD diagnosis. Experimental results on 282 MDD patients and 251 healthy control (HC) subjects demonstrate that our method outperforms several competing methods in MDD identification based on rs-fMRI data. Besides, based on our learned fully connected graphs, we can detect discriminative functional connectivities in MDD vs. HC classification, providing potential fMRI biomarkers for MDD analysis.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 50 条
  • [21] TransDSSL: Transformer Based Depth Estimation via Self-Supervised Learning
    Han, Daechan
    Shin, Jeongmin
    Kim, Namil
    Hwang, Soonmin
    Choi, Yukyung
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04): : 10969 - 10976
  • [22] MST: Masked Self-Supervised Transformer for Visual Representation
    Li, Zhaowen
    Chen, Zhiyang
    Yang, Fan
    Li, Wei
    Zhu, Yousong
    Zhao, Chaoyang
    Deng, Rui
    Wu, Liwei
    Zhao, Rui
    Tang, Ming
    Wang, Jinqiao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [23] Towards Pointsets Representation Learning via Self-Supervised Learning and Set Augmentation
    Arsomngern, Pattaramanee
    Long, Cheng
    Suwajanakorn, Supasorn
    Nutanong, Sarana
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 1201 - 1216
  • [24] Stereo Depth Estimation via Self-supervised Contrastive Representation Learning
    Tukra, Samyakh
    Giannarou, Stamatia
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VII, 2022, 13437 : 604 - 614
  • [25] Self-Supervised Facial Motion Representation Learning via Contrastive Subclips
    Sun, Zheng
    Torrie, Shad A.
    Sumsion, Andrew W.
    Lee, Dah-Jye
    ELECTRONICS, 2023, 12 (06)
  • [26] Self-Supervised Video Representation Learning via Latent Time Navigation
    Yang, Di
    Wang, Yaohui
    Kong, Quan
    Dantcheva, Antitza
    Garattoni, Lorenzo
    Francesca, Gianpiero
    Bremond, Francois
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3118 - 3126
  • [27] DocMAE: Document Image Rectification via Self-supervised Representation Learning
    Liu, Shaokai
    Feng, Hao
    Zhou, Wengang
    Li, Houqiang
    Liu, Cong
    Wu, Feng
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1613 - 1618
  • [28] METRICBERT: TEXT REPRESENTATION LEARNING VIA SELF-SUPERVISED TRIPLET TRAINING
    Malkiel, Itzik
    Ginzburg, Dvir
    Barkan, Oren
    Caciularu, Avi
    Weill, Yoni
    Koenigstein, Noam
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8142 - 8146
  • [29] Self-Supervised Representation Learning via Neighborhood-Relational Encoding
    Sabokrou, Mohammad
    Khalooei, Mohammad
    Adeli, Ehsan
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8009 - 8018
  • [30] Self-Supervised Representation Learning From Temporal Ordering of Automated Driving Sequences
    Lang, Christopher
    Braun, Alexander
    Schillingmann, Lars
    Haug, Karsten
    Valada, Abhinav
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (03) : 2582 - 2589