Deep learning and radiomics of longitudinal CT scans for early prediction of tuberculosis treatment outcomes

Background: To predict tuberculosis (TB) treatment outcomes at an early stage, prevent poor outcomes of drug -resistant tuberculosis (DR-TB) and interrupt transmission.Methods: An internal cohort for model development consists of 204 bacteriologically-confirmed TB patients who completed anti-tuberculosis treatment, with one pretreatment and two follow-up CT images (612 scans). Three radiomics feature-based models (RM) with multiple classifiers of Bagging, Random forest and Gradient boosting and two deep-learning-based models (i.e., supervised deep-learning model, SDLM; weakly supervised deep -learning model, WSDLM) are developed independently. Prediction scores of RM and deep-learning models with respectively highest performance are fused to create new fusion models under different fusion strategies. An additional independent validation was conducted on the external cohort comprising 80 patients (160 scans).Results: For RM scheme, 16 optimal radiomics features are finally selected using longitudinal scans. The AUCs of RM for Bagging, Random forest and Gradient boosting were 0.789, 0.773 and 0.764 in the internal cohort and 0.840, 0.834 and 0.816 in the external cohort, respectively. For deep learning-based scheme, AUCs of SDLM and WSDLM were 0.767 and 0.661 in the internal cohort, and 0.823 and 0.651 in the external. The fusion model yields AUCs from 0.767 to 0.802 in the internal cohort, and from 0.831 to 0.857 in the external cohort.Conclusions: Fusion of radiomics features and deep-learning model may have the potential to predict early failure outcome of DR-TB, which may be combined to help prevent poor TB treatment outcomes.