MTSS-AAE: Multi-task semi-supervised adversarial autoencoding for COVID-19 detection based on chest X-ray images

被引:33
|
作者
Ullah, Zahid [1 ]
Usman, Muhammad [2 ]
Gwak, Jeonghwan [1 ,3 ,4 ,5 ]
机构
[1] Korea Natl Univ Transportat, Dept Software, Chungju 27469, South Korea
[2] Seoul Natl Univ, Dept Comp Sci & Engn, Seoul 08826, South Korea
[3] Korea Natl Univ Transportat, Dept Biomed Engn, Chungju 27469, South Korea
[4] Korea Natl Univ Transportat, Dept AI Robot Engn, Chungju 27469, South Korea
[5] Korea Natl Univ Transportat, Dept IT Energy Convergence BK21 4, Chungju 27469, South Korea
基金
新加坡国家研究基金会;
关键词
COVID-19; Multi-task learning; Semi-supervised adversarial learning; Representation learning; Deep learning;
D O I
10.1016/j.eswa.2022.119475
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Efficient diagnosis of COVID-19 plays an important role in preventing the spread of the disease. There are three major modalities to diagnose COVID-19 which include polymerase chain reaction tests, computed tomography scans, and chest X-rays (CXRs). Among these, diagnosis using CXRs is the most economical approach; however, it requires extensive human expertise to diagnose COVID-19 in CXRs, which may deprive it of cost-effectiveness. The computer-aided diagnosis with deep learning has the potential to perform accurate detection of COVID-19 in CXRs without human intervention while preserving its cost-effectiveness. Many efforts have been made to develop a highly accurate and robust solution. However, due to the limited amount of labeled data, existing solutions are evaluated on a small set of test dataset. In this work, we proposed a solution to this problem by using a multi-task semi-supervised learning (MTSSL) framework that utilized auxiliary tasks for which adequate data is publicly available. Specifically, we utilized Pneumonia, Lung Opacity, and Pleural Effusion as additional tasks using the ChesXpert dataset. We illustrated that the primary task of COVID-19 detection, for which only limited labeled data is available, can be improved by using this additional data. We further employed an adversarial autoencoder (AAE), which has a strong capability to learn powerful and discriminative features, within our MTSSL framework to maximize the benefit of multitask learning. In addition, the supervised classification networks in combination with the unsupervised AAE empower semi-supervised learning, which includes a discriminative part in the unsupervised AAE training pipeline. The generalization of our framework is improved due to this semi-supervised learning and thus it leads to enhancement in COVID-19 detection performance. The proposed model is rigorously evaluated on the largest publicly available COVID-19 dataset and experimental results show that the proposed model attained state-of-the-art performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Semi-supervised Multi-task Learning with Chest X-Ray Images
    Imran, Abdullah-Al-Zubaer
    Terzopoulos, Demetri
    MACHINE LEARNING IN MEDICAL IMAGING (MLMI 2019), 2019, 11861 : 151 - 159
  • [2] Multi-Task Semi-Supervised Adversarial Autoencoding for Speech Emotion Recognition
    Latif, Siddique
    Rana, Rajib
    Khalifa, Sara
    Jurdak, Raja
    Epps, Julien
    Schuller, Bjoern W.
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (02) : 992 - 1004
  • [3] Correcting data imbalance for semi-supervised COVID-19 detection using X-ray chest images
    Calderon-Ramirez, Saul
    Yang, Shengxiang
    Moemeni, Armaghan
    Elizondo, David
    Colreavy-Donnelly, Simon
    Chavarria-Estrada, Luis Fernando
    Molina-Cabello, Miguel A.
    APPLIED SOFT COMPUTING, 2021, 111
  • [4] Multi-Feature Semi-Supervised Learning for COVID-19 Diagnosis from Chest X-Ray Images
    Qi, Xiao
    Foran, David J.
    Nosher, John L.
    Hacihaliloglu, Ilker
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 151 - 160
  • [5] COVID-19 Detection Using Feature Extraction and Semi-Supervised Learning from Chest X-ray Images
    Haque, Samiul
    Hoque, Mohammad Akidul
    Khan, Mohammad Ariful Islam
    Ahmed, Sabbir
    2021 IEEE REGION 10 SYMPOSIUM (TENSYMP), 2021,
  • [6] Improving Uncertainty Estimation With Semi-Supervised Deep Learning for COVID-19 Detection Using Chest X-Ray Images
    Calderon-Ramirez, Saul
    Yang, Shengxiang
    Moemeni, Armaghan
    Colreavy-Donnelly, Simon
    Elizondo, David A.
    Oala, Luis
    Rodriguez-Capitan, Jorge
    Jimenez-Navarro, Manuel
    Lopez-Rubio, Ezequiel
    Molina-Cabello, Miguel A.
    IEEE ACCESS, 2021, 9 : 85442 - 85454
  • [7] Multi-task driven explainable diagnosis of COVID-19 using chest X-ray images
    Malhotra, Aakarsh
    Mittal, Surbhi
    Majumdar, Puspita
    Chhabra, Saheb
    Thakral, Kartik
    Vatsa, Mayank
    Singh, Richa
    Chaudhury, Santanu
    Pudrod, Ashwin
    Agrawal, Anjali
    PATTERN RECOGNITION, 2022, 122
  • [8] Multi-task driven explainable diagnosis of COVID-19 using chest X-ray images
    Malhotra, Aakarsh
    Mittal, Surbhi
    Majumdar, Puspita
    Chhabra, Saheb
    Thakral, Kartik
    Vatsa, Mayank
    Singh, Richa
    Chaudhury, Santanu
    Pudrod, Ashwin
    Agrawal, Anjali
    Pattern Recognition, 2022, 122
  • [9] Multi-task localization of the hemidiaphragms and lung segmentation in portable chest X-ray images of COVID-19 patients
    Moris, Daniel, I
    de Moura, Joaquim
    Aslani, Shahab
    Jacob, Joseph
    Novo, Jorge
    Ortega, Marcos
    DIGITAL HEALTH, 2024, 10
  • [10] Dealing with Scarce Labelled Data: Semi-supervised Deep Learning with Mix Match for Covid-19 Detection Using Chest X-ray Images
    Calderon-Ramirez, Saul
    Giri, Raghvendra
    Yang, Shengxiang
    Moemeni, Armaghan
    Umana, Mario
    Elizondo, David
    Torrents-Barrena, Jordina
    Molina-Cabello, Miguel A.
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5294 - 5301