Function MRI Representation Learning via Self-supervised Transformer for Automated Brain Disorder Analysis

被引:0
|
作者
Wang, Qianqian [1 ]
Qiao, Lishan [1 ]
Liu, Mingxia [2 ]
机构
[1] Liaocheng Univ, Sch Math Sci, Liaocheng 252000, Shandong, Peoples R China
[2] Univ North Carolina Chapel Hill, Dept Radiol & BRIC, Chapel Hill, NC 27599 USA
基金
中国国家自然科学基金;
关键词
Major depressive disorder; fMRI; Transformer; CLASSIFICATION; DEPRESSION;
D O I
10.1007/978-3-031-21014-3_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Major depressive disorder (MDD) is a prevalent mental health disorder whose neuropathophysiology remains unclear. Resting-state functional magnetic resonance imaging (rs-fMRI) has been used to capture abnormality or dysfunction functional connectivity networks for automated MDD detection. A functional connectivity network (FCN) of each subject derived from rs-fMRI data can be modeled as a graph consisting of nodes and edges. Graph neural networks (GNNs) play an important role in learning representations of graph-structured data by gradually updating and aggregating node features for brain disorder analysis. However, using one single GNN layer focuses on local graph structure around each node and stacking multiple GNN layers usually leads to the over-smoothing problem. To this end, we propose a transformer-based functional MRI representation learning (TRL) framework to encode global spatial information of FCNs for MDD diagnosis. Experimental results on 282 MDD patients and 251 healthy control (HC) subjects demonstrate that our method outperforms several competing methods in MDD identification based on rs-fMRI data. Besides, based on our learned fully connected graphs, we can detect discriminative functional connectivities in MDD vs. HC classification, providing potential fMRI biomarkers for MDD analysis.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 50 条
  • [31] Self-Distilled Self-supervised Representation Learning
    Jang, Jiho
    Kim, Seonhoon
    Yoo, Kiyoon
    Kong, Chaerin
    Kim, Jangho
    Kwak, Nojun
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2828 - 2838
  • [32] Transformer-Based Self-Supervised Multimodal Representation Learning for Wearable Emotion Recognition
    Wu, Yujin
    Daoudi, Mohamed
    Amad, Ali
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (01) : 157 - 172
  • [33] Self-supervised Representation Learning on Document Images
    Cosma, Adrian
    Ghidoveanu, Mihai
    Panaitescu-Liess, Michael
    Popescu, Marius
    DOCUMENT ANALYSIS SYSTEMS, 2020, 12116 : 103 - 117
  • [34] Self-Supervised Learning for Specified Latent Representation
    Liu, Chicheng
    Song, Libin
    Zhang, Jiwen
    Chen, Ken
    Xu, Jing
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2020, 28 (01) : 47 - 59
  • [35] Self-Supervised Relational Reasoning for Representation Learning
    Patacchiola, Massimiliano
    Storkey, Amos
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [36] Adaptive Self-Supervised Graph Representation Learning
    Gong, Yunchi
    36TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2022), 2022, : 254 - 259
  • [37] Self-Supervised Speech Representation Learning: A Review
    Mohamed, Abdelrahman
    Lee, Hung-yi
    Borgholt, Lasse
    Havtorn, Jakob D.
    Edin, Joakim
    Igel, Christian
    Kirchhoff, Katrin
    Li, Shang-Wen
    Livescu, Karen
    Maaloe, Lars
    Sainath, Tara N.
    Watanabe, Shinji
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (06) : 1179 - 1210
  • [38] Distilling Localization for Self-Supervised Representation Learning
    Zhao, Nanxuan
    Wu, Zhirong
    Lau, Rynson W. H.
    Lin, Stephen
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10990 - 10998
  • [39] Context Autoencoder for Self-supervised Representation Learning
    Chen, Xiaokang
    Ding, Mingyu
    Wang, Xiaodi
    Xin, Ying
    Mo, Shentong
    Wang, Yunhao
    Han, Shumin
    Luo, Ping
    Zeng, Gang
    Wang, Jingdong
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 132 (1) : 208 - 223
  • [40] SELF-SUPERVISED REPRESENTATION LEARNING FOR ULTRASOUND VIDEO
    Jiao, Jianbo
    Droste, Richard
    Drukker, Lior
    Papageorghiou, Aris T.
    Noble, J. Alison
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 1847 - 1850