Combined molecular subtyping, grading, and segmentation of glioma using multi-task deep learning

被引:67
|
作者
van der Voort, Sebastian R. [1 ]
Incekara, Fatih [2 ,3 ]
Wijnenga, Maarten M. J. [4 ]
Kapsas, Georgios [2 ]
Gahrmann, Renske [2 ]
Schouten, Joost W. [3 ]
Tewarie, Rishi Nandoe [5 ]
Lycklama, Geert J. [6 ]
Hamer, Philip C. De Witt [9 ]
Eijgelaar, Roelant S. [9 ]
French, Pim J. [4 ]
Dubbink, Hendrikus J. [7 ]
Vincent, Arnaud J. P. E. [3 ]
Niessen, Wiro J. [1 ,8 ]
van den Bent, Martin J. [4 ]
Smits, Marion [2 ]
Klein, Stefan [1 ]
机构
[1] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Biomed Imaging Grp Rotterdam, Dr Molewaterpl 50-60, NL-3015 GE Rotterdam, Netherlands
[2] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Rotterdam, Netherlands
[3] Erasmus MC Univ Med Ctr Rotterdam, Brain Tumor Ctr, Dept Neurosurg, Rotterdam, Netherlands
[4] Erasmus MC, Brain Tumor Ctr, Dept Neurol, Canc Inst, Rotterdam, Netherlands
[5] Haaglanden Med Ctr, Dept Neurosurg, The Hague, Netherlands
[6] Haaglanden Med Ctr, Dept Radiol, The Hague, Netherlands
[7] Brain Tumor Ctr Erasmus MC Canc Inst, Dept Pathol, Rotterdam, Netherlands
[8] Delft Univ Technol, Fac Appl Sci, Imaging Phys, Delft, Netherlands
[9] Amsterdam UMC, Brain Tumor Ctr, Dept Neurosurg, Canc Ctr Amsterdam, Amsterdam, Netherlands
关键词
deep learning; glioma; multi-task; radiomics; segmentation; CENTRAL-NERVOUS-SYSTEM; RADIOMICS; CLASSIFICATION; CHALLENGES; TUMORS;
D O I
10.1093/neuonc/noac166
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Background Accurate characterization of glioma is crucial for clinical decision making. A delineation of the tumor is also desirable in the initial decision stages but is time-consuming. Previously, deep learning methods have been developed that can either non-invasively predict the genetic or histological features of glioma, or that can automatically delineate the tumor, but not both tasks at the same time. Here, we present our method that can predict the molecular subtype and grade, while simultaneously providing a delineation of the tumor. Methods We developed a single multi-task convolutional neural network that uses the full 3D, structural, preoperative MRI scans to predict the IDH mutation status, the 1p/19q co-deletion status, and the grade of a tumor, while simultaneously segmenting the tumor. We trained our method using a patient cohort containing 1508 glioma patients from 16 institutes. We tested our method on an independent dataset of 240 patients from 13 different institutes. Results In the independent test set, we achieved an IDH-AUC of 0.90, an 1p/19q co-deletion AUC of 0.85, and a grade AUC of 0.81 (grade II/III/IV). For the tumor delineation, we achieved a mean whole tumor Dice score of 0.84. Conclusions We developed a method that non-invasively predicts multiple, clinically relevant features of glioma. Evaluation in an independent dataset shows that the method achieves a high performance and that it generalizes well to the broader clinical population. This first-of-its-kind method opens the door to more generalizable, instead of hyper-specialized, AI methods.
引用
收藏
页码:279 / 289
页数:11
相关论文
共 50 条
  • [41] A Survey of Multi-Task Deep Reinforcement Learning
    Vithayathil Varghese, Nelson
    Mahmoud, Qusay H.
    ELECTRONICS, 2020, 9 (09) : 1 - 21
  • [42] Multi-Task Deep Reinforcement Learning with PopArt
    Hessel, Matteo
    Soyer, Hubert
    Espeholt, Lasse
    Czarnecki, Wojciech
    Schmitt, Simon
    van Hasselt, Hado
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 3796 - 3803
  • [43] Cancer Classification with Multi-task Deep Learning
    Liao, Qing
    Jiang, Lin
    Wang, Xuan
    Zhang, Chunkai
    Ding, Ye
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 76 - 81
  • [44] Deep Learning for Multi-task Plant Phenotyping
    Pound, Michael P.
    Atkinson, Jonathan A.
    Wells, Darren M.
    Pridmore, Tony P.
    French, Andrew P.
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2055 - 2063
  • [45] Multi-task Deep Learning for Image Understanding
    Yu, Bo
    Lane, Ian
    2014 6TH INTERNATIONAL CONFERENCE OF SOFT COMPUTING AND PATTERN RECOGNITION (SOCPAR), 2014, : 37 - 42
  • [46] Deep Asymmetric Multi-task Feature Learning
    Lee, Hae Beom
    Yang, Eunho
    Hwang, Sung Ju
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [47] A Multi-Task Based Deep Learning Framework With Landmark Detection for MRI Couinaud Segmentation
    Miao, Dong
    Zhao, Ying
    Ren, Xue
    Dou, Meng
    Yao, Yu
    Xu, Yiran
    Cui, Yingchao
    Liu, Ailian
    IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2024, 12 : 697 - 710
  • [48] Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images
    Volpi, Michele
    Tuia, Devis
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 144 : 48 - 60
  • [49] Interdependent Multi-task Learning for Simultaneous Segmentation and Detection
    Reginthala, Mahesh
    Iwahori, Yuji
    Bhuyan, M. K.
    Hayashi, Yoshitsugu
    Achariyaviriya, Witsarut
    Kijsirikul, Boonserm
    ICPRAM: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2020, : 167 - 174
  • [50] NMTNet: A Multi-task Deep Learning Network for Joint Segmentation and Classification of Breast Tumors
    Yang, Xuelian
    Wang, Yuanjun
    Sui, Li
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2025,