Graph-based multi-modality integration for prediction of cancer subtype and severity

被引:1
|
作者
Duroux, Diane [1 ,5 ]
Wohlfart, Christian [2 ]
Van Steen, Kristel [1 ,3 ]
Vladimirova, Antoaneta [4 ]
King, Michael [2 ]
机构
[1] Univ Liege, GIGA R Med Genom, BIO3 Syst Genet, B-4000 Liege, Belgium
[2] Roche Diag GmbH, Penzberg, Germany
[3] BIO3 Syst Med, Dept Human Genet, B-3000 Leuven, Belgium
[4] Roche Diag Corp, Roche Informat Solut, Santa Clara, CA 95050 USA
[5] ETH AI Ctr, Zurich, Switzerland
来源
SCIENTIFIC REPORTS | 2023年 / 13卷 / 01期
基金
欧盟地平线“2020”;
关键词
TUMOR; MUTATIONS; DISEASE; BREAST;
D O I
10.1038/s41598-023-46392-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Personalised cancer screening before therapy paves the way toward improving diagnostic accuracy and treatment outcomes. Most approaches are limited to a single data type and do not consider interactions between features, leaving aside the complementary insights that multimodality and systems biology can provide. In this project, we demonstrate the use of graph theory for data integration via individual networks where nodes and edges are individual-specific. We showcase the consequences of early, intermediate, and late graph-based fusion of RNA-Seq data and histopathology whole-slide images for predicting cancer subtypes and severity. The methodology developed is as follows: (1) we create individual networks; (2) we compute the similarity between individuals from these graphs; (3) we train our model on the similarity matrices; (4) we evaluate the performance using the macro F1 score. Pros and cons of elements of the pipeline are evaluated on publicly available real-life datasets. We find that graph-based methods can increase performance over methods that do not study interactions. Additionally, merging multiple data sources often improves classification compared to models based on single data, especially through intermediate fusion. The proposed workflow can easily be adapted to other disease contexts to accelerate and enhance personalized healthcare.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Multi-modality deep learning model reaches high prediction accuracy in the diagnosis of ovarian cancer
    Wang, Zimo
    Luo, Shuyu
    Chen, Jing
    Jiao, Yang
    Cui, Chen
    Shi, Siyuan
    Yang, Yang
    Zhao, Junyi
    Jiang, Yitao
    Zhang, Yujuan
    Xu, Fanhua
    Xu, Jinfeng
    Lin, Qi
    Dong, Fajin
    ISCIENCE, 2024, 27 (04)
  • [42] Multi-Modality Convolutional Neural Network for Lynxph Node Metastasis Prediction in Head and Neck Cancer
    Chen, L.
    Zhou, Z.
    Sher, D.
    Zhang, Q.
    Shah, J.
    Pham, N.
    Jiang, S.
    Wang, J.
    MEDICAL PHYSICS, 2018, 45 (06) : E679 - E679
  • [43] Holistic Graph-based Motion Prediction
    Grimm, Daniel
    Schoerner, Philip
    Dressler, Moritz
    Zoellner, J-Marius
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 2965 - 2972
  • [44] Graph-based explainable vulnerability prediction
    Nguyen, Hong Quy
    Hoang, Thong
    Dam, Hoa Khanh
    Ghose, Aditya
    INFORMATION AND SOFTWARE TECHNOLOGY, 2025, 177
  • [45] Graph-Based Prediction of Meeting Participation
    Murray, Gabriel
    MULTIMODAL TECHNOLOGIES AND INTERACTION, 2019, 3 (03)
  • [46] Graph-Based Chinese Word Sense Disambiguation with Multi-Knowledge Integration
    Lu, Wenpeng
    Meng, Fanqing
    Wang, Shoujin
    Zhang, Guoqiang
    Zhang, Xu
    Ouyang, Antai
    Zhang, Xiaodong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2019, 61 (01): : 197 - 212
  • [47] Learning based Multi-modality Image and Video Compression
    Lu, Guo
    Zhong, Tianxiong
    Geng, Jing
    Hu, Qiang
    Xu, Dong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 6073 - 6082
  • [48] Object Tracking Based on Multi-modality Dictionary Learning
    Wang, Jing
    Zhu, Hong
    Xue, Shan
    Shi, Jing
    IMAGE AND GRAPHICS (ICIG 2017), PT II, 2017, 10667 : 129 - 138
  • [49] CNNs Based Multi-Modality Classification for AD Diagnosis
    Cheng, Danni
    Liu, Manhua
    2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,
  • [50] Symmetry based multi-modality registration of the brain imagery
    Liu, Xin
    Imielinska, Celina
    Laine, Andrew Francis
    D'Ambrosio, Anthony
    2007 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY, VOLS 1-3, 2007, : 1081 - +