Benign vs malignant vertebral compression fractures with MRI: a comparison between automatic deep learning network and radiologist's assessment

ObjectiveTo test the diagnostic performance of a deep-learning Two-Stream Compare and Contrast Network (TSCCN) model for differentiating benign and malignant vertebral compression fractures (VCFs) based on MRI.MethodsWe tested a deep-learning system in 123 benign and 86 malignant VCFs. The median sagittal T1-weighted images (T1WI), T2-weighted images with fat suppression (T2WI-FS), and a combination of both (thereafter, T1WI/T2WI-FS) were used to validate TSCCN. The receiver operator characteristic (ROC) curve was analyzed to evaluate the performance of TSCCN. The accuracy, sensitivity, and specificity of TSCCN in differentiating benign and malignant VCFs were calculated and compared with radiologists' assessments. Intraclass correlation coefficients (ICCs) were tested to find intra- and inter-observer agreement of radiologists in differentiating malignant from benign VCFs.ResultsThe AUC of the ROC plots of TSCCN according to T1WI, T2WI-FS, and T1WI/T2WI-FS images were 99.2%, 91.7%, and 98.2%, respectively. The accuracy of T1W, T2WI-FS, and T1W/T2WI-FS based on TSCCN was 95.2%, 90.4%, and 96.2%, respectively, greater than that achieved by radiologists. Further, the specificity of T1W, T2WI-FS, and T1W/T2WI-FS based on TSCCN was higher at 98.4%, 94.3%, and 99.2% than that achieved by radiologists. The intra- and inter-observer agreements of radiologists were 0.79-0.85 and 0.79-0.80 for T1WI, 0.65-0.72 and 0.70-0.74 for T2WI-FS, and 0.83-0.88 and 0.83-0.84 for T1WI/T2WI-FS.ConclusionThe TSCCN model showed better diagnostic performance than radiologists for automatically identifying benign or malignant VCFs, and is a potentially helpful tool for future clinical application.