Risk Prediction of Stereotactic-Body-Radiotherapy-Induced Vertebral Compression Fracture Using Multi-Modal Deep Learning Network

被引:0
|
作者
Lee, Seoyoung [1 ]
Kim, Hyoyi [1 ]
Kim, Haeyoung [2 ]
Cho, Seungryong [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Nucl & Quantum Engn, Daejeon, South Korea
[2] Sungkyunkwan Univ, Samsung Med Ctr, Dept Radiat Oncol, Sch Med, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Stereotactic body radiotherapy; Vertebral compression fracture; deep learning; risk prediction;
D O I
10.1117/12.3006647
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereotactic body radiotherapy (SBRT) has been widely used to treat spinal bone metastases. However, it has been reported that individuals may suffer from vertebral compression fracture (VCF) after the treatment, hence it is necessary to identify possible risk groups prior to performing SBRT. Several studies have been made to identify the risk factors, including spinal instability neoplastic score (SINS), dose fractionation, and radiomics. However, no studies have attempted to predict VCF occurrence by direct usage of patients' pretreatment CT images. In this study, we propose a multi-modal deep network for risk prediction of VCF after SBRT that uses clinical records, CT images, and radiotherapy factors altogether without explicit feature extraction. The retrospective study was conducted on a cohort of 131 patients who received SBRT for spinal bone metastasis. We classified the risk factors into three categories: clinical factors, anatomical imaging factors, and radiotherapy factors. 1-D vectors were generated from clinical factors after a proper standardization. We cropped 3-D patches of the lesion area from pretreatment CT images and treatment planning dose images. We used data augmentation with translation and rotation in the sagittal plane based on the characteristics of the S-shaped spine to supplement the limited size of our available dataset. Numerical variables from radiotherapy factors are standardized along with the clinical feature vector. We designed a three-branch deep learning network with the aforementioned three factors as inputs. From the k-fold validation and ablation study, our proposed network showed performance with an area under the curve (AUC) of 0.7605 and an average precision (AP) of 0.7273. The results show an improvement over other unimodal comparison models. The prediction model would play a valuable role not only in the treated patients' welfare but also in the treatment planning for those patients.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Multi-Modal Deep Learning Models for Alzheimer's Disease Prediction Using MRI and EHR
    Prabhu, Sathvik S.
    Berkebile, John A.
    Rajagopalan, Neha
    Yao, Renjie
    Shi, Wenqi
    Giuste, Felipe
    Zhong, Yishan
    Sun, Jimin
    Wang, May D.
    2022 IEEE 22ND INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING (BIBE 2022), 2022, : 168 - 173
  • [32] Antiresorptive Medications Prior to Stereotactic Body Radiotherapy for Spinal Metastasis are Associated with Reduced Incidence of Vertebral Body Compression Fracture
    Patel, Palak P.
    Esposito, Edward P.
    Zhu, Jiafeng
    Chen, Xuguang
    Khan, Majid
    Kleinberg, Lawrence
    Lubelski, Daniel
    Theodore, Nicholas
    Lo, Sheng-fu Larry
    Hun Lee, Sang
    Kebaish, Khaled
    Bydon, Ali
    Redmond, Kristin J.
    GLOBAL SPINE JOURNAL, 2024, 14 (06) : 1778 - 1785
  • [33] Risk of Vertebral Fracture and Local Recurrence after Palliative Spine Stereotactic Body Radiotherapy (SBRT)
    Susko, M. S.
    Zeimer, B. P.
    Ma, L.
    Fogh, S.
    Golden, E. B.
    Raleigh, D.
    Nakamura, J. L.
    Gottschalk, A. R.
    Sneed, P. K.
    Braunstein, S. E.
    INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2019, 105 (01): : E126 - E126
  • [34] Multi-modal deep learning for joint prediction of otitis media and diagnostic difficulty
    Sundgaard, Josefine Vilsboll
    Hannemose, Morten Rieger
    Laugesen, Soren
    Bray, Peter
    Harte, James
    Kamide, Yosuke
    Tanaka, Chiemi
    Paulsen, Rasmus R.
    Christensen, Anders Nymark
    LARYNGOSCOPE INVESTIGATIVE OTOLARYNGOLOGY, 2024, 9 (01):
  • [35] MMDL: A Novel Multi-modal Deep Learning Model for Stock Market Prediction
    2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 1070 - 1071
  • [36] Multi-modal advanced deep learning architectures for breast cancer survival prediction
    Arya, Nikhilanand
    Saha, Sriparna
    KNOWLEDGE-BASED SYSTEMS, 2021, 221
  • [37] Multi-modal deep learning framework for head & neck cancer outcome prediction
    Diamant, Andre
    Chatterjee, Avishek
    Vallieres, Martin
    Shenouda, George
    Seuntjens, Jan
    MEDICAL PHYSICS, 2019, 46 (11) : 5372 - 5372
  • [38] A Normal Tissue Complication Probability Model for Vertebral Compression Fracture after Stereotactic Body Radiotherapy for Spine Metastasis
    Chen, X.
    Grimm, J.
    Gui, C.
    Kleinberg, L. R.
    Lo, L.
    Sciubba, D. M.
    Khan, M.
    Redmond, K. J.
    INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2019, 105 (01): : E121 - E122
  • [39] Multi-modal vertebrae recognition using Transformed Deep Convolution Network
    Cai, Yunliang
    Landis, Mark
    Laidley, David T.
    Kornecki, Anat
    Lum, Andrea
    Li, Shuo
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2016, 51 : 11 - 19
  • [40] Classifying Excavator Operations with Fusion Network of Multi-modal Deep Learning Models
    Kim, Jin-Young
    Cho, Sung-Bae
    14TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING MODELS IN INDUSTRIAL AND ENVIRONMENTAL APPLICATIONS (SOCO 2019), 2020, 950 : 25 - 34