MGNN: A Multimodal Graph Neural Network for Predicting the Survival of Cancer Patients

被引:39
|
作者
Gao, Jianliang [1 ]
Lyu, Tengfei [1 ]
Xiong, Fan [1 ]
Wang, Jianxin [1 ]
Ke, Weimao [2 ]
Li, Zhao [3 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha, Peoples R China
[2] Drexel Univ, Coll Comp & Informat, Philadelphia, PA USA
[3] Alibaba Grp, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical information retrieval; Cancer survival prediction; Graph neural networks; Multimodal; PROGNOSIS;
D O I
10.1145/3397271.3401214
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predicting the survival of cancer patients holds significant meaning for public health, and has attracted increasing attention in medical information communities. In this study, we propose a novel framework for cancer survival prediction named Multimodal Graph Neural Network (MGNN), which explores the features of real-world multimodal data such as gene expression, copy number alteration and clinical data in a unified framework. In order to explore the inherent relation, we first construct the bipartite graphs between patients and multimodal data. Subsequently, graph neural network is adopted to obtain the embedding of each patient on different bipartite graphs. Finally, a multimodal fusion neural layer is designed to fuse the features from different modal data. The output of our method is the classification of short term survival or long term survival for each patient. Experimental results on one breast cancer dataset demonstrate that MGNN outperforms all baselines. Furthermore, we test the trained model on lung cancer dataset, and the experimental results verify the strong robust by comparing with state-of-the-art methods.
引用
收藏
页码:1697 / 1700
页数:4
相关论文
共 50 条
  • [11] Multimodal graph neural network for video procedural captioning
    Ji, Lei
    Tu, Rongcheng
    Lin, Kevin
    Wang, Lijuan
    Duan, Nan
    NEUROCOMPUTING, 2022, 488 : 88 - 96
  • [12] Predicting Brain Degeneration with a Multimodal Siamese Neural Network
    Ostertag, Cecilia
    Beurton-Aimar, Marie
    Visani, Muriel
    Urruty, Thierry
    Bertet, Karell
    2020 TENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2020,
  • [13] Hybrid Graph Convolutional Network With Online Masked Autoencoder for Robust Multimodal Cancer Survival Prediction
    Hou, Wentai
    Lin, Chengxuan
    Yu, Lequan
    Qin, Jing
    Yu, Rongshan
    Wang, Liansheng
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (08) : 2462 - 2473
  • [14] SELECTOR: Heterogeneous graph network with convolutional masked autoencoder for multimodal robust prediction of cancer survival
    Pan L.
    Peng Y.
    Li Y.
    Wang X.
    Liu W.
    Xu L.
    Liang Q.
    Peng S.
    Computers in Biology and Medicine, 2024, 172
  • [15] A depression detection model based on multimodal graph neural network
    Xia, Yujing
    Liu, Lin
    Dong, Tao
    Chen, Juan
    Cheng, Yu
    Tang, Lin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (23) : 63379 - 63395
  • [16] Predicting the Survival of Diabetes using Neural Network
    Mamuda, Mamman
    Sathasivam, Saratha
    PROCEEDINGS OF THE 24TH NATIONAL SYMPOSIUM ON MATHEMATICAL SCIENCES (SKSM24): MATHEMATICAL SCIENCES EXPLORATION FOR THE UNIVERSAL PRESERVATION, 2017, 1870
  • [17] Bidirectional recurrent neural network approach for predicting cervical cancer recurrence and survival
    Geeitha, S.
    Prabha, K. P. Rama
    Cho, Jaehyuk
    Easwaramoorthy, Sathishkumar Veerappampalayam
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [18] MULTIMODAL GRAPH COARSENING FOR INTERPRETABLE, MRI-BASED BRAIN GRAPH NEURAL NETWORK
    Sebenius, Isaac
    Campbell, Alexander
    Morgan, Sarah E.
    Bullmore, Edward T.
    Lio, Pietro
    2021 IEEE 31ST INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2021,
  • [19] Predicting Survival of Patients with Node-positive Prostate Cancer Following Multimodal Treatment
    Abdollah, Firas
    Karnes, R. Jeffrey
    Suardi, Nazareno
    Cozzarini, Cesare
    Gandaglia, Giorgio
    Fossati, Nicola
    Bianchi, Marco
    Boorjian, Stephen A.
    Sun, Maxine
    Karakiewicz, Pierre I.
    Montorsi, Francesco
    Briganti, Alberto
    EUROPEAN UROLOGY, 2014, 65 (03) : 554 - 562
  • [20] Comparison between artificial neural network and Cox regression model in predicting the survival rate of gastric cancer patients
    Zhu, Lucheng
    Luo, Wenhua
    Su, Meng
    Wei, Hangping
    Wei, Juan
    Zhang, Xuebang
    Zou, Changlin
    BIOMEDICAL REPORTS, 2013, 1 (05) : 757 - 760