Dual attention multiple instance learning with unsupervised complementary loss for COVID-19 screening

被引:30
|
作者
Chikontwe, Philip [1 ]
Luna, Miguel [1 ]
Kang, Myeongkyun [1 ]
Hong, Kyung Soo [2 ]
Ahn, June Hong [2 ]
Park, Sang Hyun [1 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol DGIST, Dept Robot Engn, Daegu, South Korea
[2] Yeungnam Univ, Yeungnam Univ Med Ctr, Coll Med, Reg Ctr Resp Dis,Div Pulmonol & Allergy,Dept Inte, Daegu, South Korea
基金
新加坡国家研究基金会;
关键词
COVID-19; CT images; Deep learning; Multiple instance learning; Unsupervised complementary loss; DEEP; CLASSIFICATION; DIAGNOSIS; ROBUST;
D O I
10.1016/j.media.2021.102105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chest computed tomography (CT) based analysis and diagnosis of the Coronavirus Disease 2019 (COVID19) plays a key role in combating the outbreak of the pandemic that has rapidly spread worldwide. To date, the disease has infected more than 18 million people with over 690k deaths reported. Reverse transcription polymerase chain reaction (RT-PCR) is the current gold standard for clinical diagnosis but may produce false positives; thus, chest CT based diagnosis is considered more viable. However, accurate screening is challenging due to the difficulty in annotation of infected areas, curation of large datasets, and the slight discrepancies between COVID-19 and other viral pneumonia. In this study, we propose an attention-based end-to-end weakly supervised framework for the rapid diagnosis of COVID-19 and bacterial pneumonia based on multiple instance learning (MIL). We further incorporate unsupervised contrastive learning for improved accuracy with attention applied both in spatial and latent contexts, herein we propose Dual Attention Contrastive based MIL (DA-CMIL). DA-CMIL takes as input several patient CT slices (considered as bag of instances) and outputs a single label. Attention based pooling is applied to implicitly select key slices in the latent space, whereas spatial attention learns slice spatial context for interpretable diagnosis. A contrastive loss is applied at the instance level to encode similarity of features from the same patient against representative pooled patient features. Empirical results show that our algorithm achieves an overall accuracy of 98.6% and an AUC of 98.4%. Moreover, ablation studies show the benefit of contrastive learning with MIL. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Accurate Screening of COVID-19 Using Attention-Based Deep 3D Multiple Instance Learning
    Han, Zhongyi
    Wei, Benzheng
    Hong, Yanfei
    Li, Tianyang
    Cong, Jinyu
    Zhu, Xue
    Wei, Haifeng
    Zhang, Wei
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (08) : 2584 - 2594
  • [2] Attention-Based Multiple Instance Learning AI in the Prediction of Treatment for COVID-19 Patients
    Fuhrman, J.
    Wei, C.
    Katsnelson, B.
    Katsnelson, E.
    Li, H.
    Luo, Z.
    Dong, Z.
    Lure, F.
    Cheng, Z.
    Giger, M.
    MEDICAL PHYSICS, 2022, 49 (06) : E683 - E683
  • [3] Acoustic COVID-19 Detection Using Multiple Instance Learning
    Reiter, Michael
    Pernkopf, Franz
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2025, 29 (01) : 620 - 630
  • [4] Loss-Based Attention for Deep Multiple Instance Learning
    Shi, Xiaoshuang
    Xing, Fuyong
    Xie, Yuanpu
    Zhang, Zizhao
    Cui, Lei
    Yang, Lin
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 5742 - 5749
  • [5] UNSUPERVISED MULTIPLE-INSTANCE LEARNING FOR INSTANCE SEARCH
    Wang, Zhenzhen
    Yuan, Junsong
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,
  • [6] An Improved COVID-19 Classification Model on Chest Radiography by Dual-Ended Multiple Attention Learning
    Fan, Yongxian
    Gong, Hao
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (01) : 145 - 156
  • [7] Unsupervised Dual Learning for Feature and Instance Selection
    Du, Liang
    Ren, Xin
    Zhou, Peng
    Hu, Zhiguo
    IEEE ACCESS, 2020, 8 : 170248 - 170260
  • [8] Fast Unsupervised Residual Attention GAN for COVID-19 Detection
    Nafti, Najeh
    Besbes, Olfa
    Ben Abdallah, Asma
    Bedoui, Mohamed Hedi
    ADVANCES IN COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2022, 2022, 1653 : 360 - 372
  • [9] The COVID-19 Learning Loss: Fact or Stigma?
    Mitchell, Brandon D.
    Greer, Carl D.
    CHILDREN & SCHOOLS, 2022, 44 (04) : 251 - 254
  • [10] Newspaper Constructions of the COVID-19 Learning Loss
    Mitchell, Brandon D.
    CRITICAL EDUCATION, 2023, 14 (04): : 42 - 74