Risk Prediction of Stereotactic-Body-Radiotherapy-Induced Vertebral Compression Fracture Using Multi-Modal Deep Learning Network

被引:0
|
作者
Lee, Seoyoung [1 ]
Kim, Hyoyi [1 ]
Kim, Haeyoung [2 ]
Cho, Seungryong [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Nucl & Quantum Engn, Daejeon, South Korea
[2] Sungkyunkwan Univ, Samsung Med Ctr, Dept Radiat Oncol, Sch Med, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Stereotactic body radiotherapy; Vertebral compression fracture; deep learning; risk prediction;
D O I
10.1117/12.3006647
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereotactic body radiotherapy (SBRT) has been widely used to treat spinal bone metastases. However, it has been reported that individuals may suffer from vertebral compression fracture (VCF) after the treatment, hence it is necessary to identify possible risk groups prior to performing SBRT. Several studies have been made to identify the risk factors, including spinal instability neoplastic score (SINS), dose fractionation, and radiomics. However, no studies have attempted to predict VCF occurrence by direct usage of patients' pretreatment CT images. In this study, we propose a multi-modal deep network for risk prediction of VCF after SBRT that uses clinical records, CT images, and radiotherapy factors altogether without explicit feature extraction. The retrospective study was conducted on a cohort of 131 patients who received SBRT for spinal bone metastasis. We classified the risk factors into three categories: clinical factors, anatomical imaging factors, and radiotherapy factors. 1-D vectors were generated from clinical factors after a proper standardization. We cropped 3-D patches of the lesion area from pretreatment CT images and treatment planning dose images. We used data augmentation with translation and rotation in the sagittal plane based on the characteristics of the S-shaped spine to supplement the limited size of our available dataset. Numerical variables from radiotherapy factors are standardized along with the clinical feature vector. We designed a three-branch deep learning network with the aforementioned three factors as inputs. From the k-fold validation and ablation study, our proposed network showed performance with an area under the curve (AUC) of 0.7605 and an average precision (AP) of 0.7273. The results show an improvement over other unimodal comparison models. The prediction model would play a valuable role not only in the treated patients' welfare but also in the treatment planning for those patients.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Robust Deep Multi-modal Learning Based on Gated Information Fusion Network
    Kim, Jaekyum
    Koh, Junho
    Kim, Yecheol
    Choi, Jaehyung
    Hwang, Youngbae
    Choi, Jun Won
    COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 90 - 106
  • [42] Deep reinforcement learning for financial trading using multi-modal features
    Avramelou, Loukia
    Nousi, Paraskevi
    Passalis, Nikolaos
    Tefas, Anastasios
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [43] Multi-modal data clustering using deep learning: A systematic review
    Raya, Sura
    Orabi, Mariam
    Afyouni, Imad
    Al Aghbari, Zaher
    NEUROCOMPUTING, 2024, 607
  • [44] Multi-Modal Data Analysis for Pneumonia Status Prediction Using Deep Learning (MDA-PSP)
    Sheu, Ruey-Kai
    Chen, Lun-Chi
    Wu, Chieh-Liang
    Pardeshi, Mayuresh Sunil
    Pai, Kai-Chih
    Huang, Chien-Chung
    Chen, Chia-Yu
    Chen, Wei-Cheng
    DIAGNOSTICS, 2022, 12 (07)
  • [45] Prediction of subsequent osteoporotic vertebral compression fracture on CT radiography via deep learning
    Hu, Xiao
    Zhu, Yanjing
    Qian, Yadong
    Huang, Ruiqi
    Yin, Shuai
    Zeng, Zhili
    Xie, Ning
    Ma, Bin
    Yu, Yan
    Zhao, Qing
    Wu, Zhourui
    Wang, Jianjie
    Xu, Wei
    Ren, Yilong
    Li, Chen
    Zhu, Rongrong
    Cheng, Liming
    VIEW, 2022, 3 (06)
  • [46] Direct Multi-Modal Inversion of Geophysical Logs Using Deep Learning
    Alyaev, Sergey
    Elsheikh, Ahmed H.
    EARTH AND SPACE SCIENCE, 2022, 9 (09)
  • [47] Prediction of Subacute Infarction in Acute Ischemic Stroke Using Baseline Multi-modal MRI and Deep Learning
    Yu Yannan
    Xie, Yuan
    Thamm, Thoralf
    Chen, Kevin T.
    Gong Enhao
    Zaharchuk, Greg
    STROKE, 2019, 50
  • [48] Osteoporotic Vertebral Fracture Classification in X-rays Based on a Multi-modal Semantic Consistency Network
    Wang, Yuzhao
    Bai, Tian
    Li, Tong
    Huang, Lan
    JOURNAL OF BIONIC ENGINEERING, 2022, 19 (06) : 1816 - 1829
  • [49] Osteoporotic Vertebral Fracture Classification in X-rays Based on a Multi-modal Semantic Consistency Network
    Yuzhao Wang
    Tian Bai
    Tong Li
    Lan Huang
    Journal of Bionic Engineering, 2022, 19 : 1816 - 1829
  • [50] Volumetric Dosimetry Analysis of Vertebral Compression Fracture Risk Following Spine Stereotactic Body Radiation Therapy
    Feeny, A. K.
    Balagamwala, E. H.
    Chao, S. T.
    Angelov, L.
    Suh, J. H.
    Mohammadi, A. M.
    Magnelli, A.
    Xia, P.
    INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2017, 99 (02): : E658 - E659