Ensembles of Convolutional Neural Network models for pediatric pneumonia diagnosis

被引:34
|
作者
Liz, Helena [1 ,6 ]
Sanchez-Montanes, Manuel [2 ]
Tagarro, Alfredo [3 ,4 ]
Dominguez-Rodriguez, Sara [4 ]
Dagan, Ron [5 ]
Camacho, David [1 ]
机构
[1] Univ Politecn Madrid, Comp Syst Engn Dept, Madrid, Spain
[2] Univ Autonoma Madrid, Comp Sci Dept, Madrid, Spain
[3] Univ Europea Madrid, Pediat Res Grp, Hosp Univ Infanta Sofia, Pediat Dept, Madrid, Spain
[4] Fdn Invest Biomed Hosp 12 Octubre, Pediat Res & Clin Trials Unit UPIC, Inst Invest Sanitaria Hosp 12 Octubre IMAS12, Madrid, Spain
[5] Ben Gurion Univ Negev, Fac Hlth Sci, Beer Sheva, Israel
[6] Univ Rey Juan Carlos, Dept Comp Sci, Madrid, Spain
关键词
Ensembles of Convolutional Neural; Networks; eXplainable Artificial Intelligence; Heatmaps; Pneumonia; Pediatrics; CHILDREN;
D O I
10.1016/j.future.2021.04.007
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Pneumonia is a lung infection that causes 15% of childhood mortality (under 5 years old), over 800,000 children under five every year, around 2,200 every day, all over the world. This pathology is mainly caused by viruses or bacteria. X-rays imaging analysis is one of the most used methods for pneumonia diagnosis. These clinical images can be analyzed using machine learning methods such as convolutional neural networks (CNN), which learn to extract critical features for the classification. However, the usability of these systems is limited in medicine due to the lack of interpretability, because of these models cannot be used to generate an understandable explanation (from a human-based perspective), about how they have reached those results. Another problem that difficults the impact of this technology is the limited amount of labeled data in many medicine domains. The main contributions of this work are two fold: the first one is the design of a new explainable artificial intelligence (XAI) technique based on combining the individual heatmaps obtained from each model in the ensemble. This allows to overcome the explainability and interpretability problems of the CNN "black boxes'', highlighting those areas of the image which are more relevant to generate the classification. The second one is the development of new ensemble deep learning models to classify chest X-rays that allow highly competitive results using small datasets for training. We tested our ensemble model using a small dataset of pediatric X-rays (950 samples of children between one month and 16 years old) with low quality and anatomical variability (which represents one of the biggest challenges addressed in this work). We also tested other strategies such as single CNNs trained from scratch and transfer learning using CheXNet. Our results show that our ensemble model clearly outperforms these strategies obtaining highly competitive results. Finally we confirmed the robustness of our approach using another pneumonia diagnosis dataset (Kermany et al., 2018). (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:220 / 233
页数:14
相关论文
共 50 条
  • [1] Bayesian convolutional neural network estimation for pediatric pneumonia detection and diagnosis
    Fernandes, Vandecia
    Braz Junior, Geraldo
    de Paiva, Anselmo Cardoso
    Silva, Aristofanes Correa
    Gattass, Marcelo
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 208
  • [2] A hybrid deep convolutional neural network model for improved diagnosis of pneumonia
    Palvinder Singh Mann
    Shailesh D. Panchal
    Satvir Singh
    Guramritpal Singh Saggu
    Keshav Gupta
    Neural Computing and Applications, 2024, 36 : 1791 - 1804
  • [3] A hybrid deep convolutional neural network model for improved diagnosis of pneumonia
    Mann, Palvinder Singh
    Panchal, Shailesh D.
    Singh, Satvir
    Saggu, Guramritpal Singh
    Gupta, Keshav
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (04): : 1791 - 1804
  • [4] Automated Pneumonia Diagnosis using a Customized Sequential Convolutional Neural Network
    Siddiqi, Raheel
    ICDLT 2019: 2019 3RD INTERNATIONAL CONFERENCE ON DEEP LEARNING TECHNOLOGIES, 2019, : 64 - 70
  • [5] Implementation of a Mobile Application based on the Convolutional Neural Network for the Diagnosis of Pneumonia
    Flores-Rodriguez, Jazmin
    Cabanillas-Carbonell, Michael
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (08) : 463 - 472
  • [6] Deep convolutional neural network models for the diagnosis of thyroid cancer
    Li, Xiangchun
    Zhang, Sheng
    Zhang, Qiang
    Wei, Xi
    Gao, Ming
    Zhang, Wei
    Chen, Kexin
    LANCET ONCOLOGY, 2019, 20 (03): : E131 - E131
  • [7] Clustering ensembles of neural network models
    Bakker, B
    Heskes, T
    NEURAL NETWORKS, 2003, 16 (02) : 261 - 269
  • [8] Deep Convolutional Neural Network Ensembles Using ECOC
    Ahmed, Sara Atito Ali
    Zor, Cemre
    Awais, Muhammad
    Yanikoglu, Berrin
    Kittler, Josef
    IEEE ACCESS, 2021, 9 : 86083 - 86095
  • [9] Visualization and Interpretation of Convolutional Neural Network Predictions in Detecting Pneumonia in Pediatric Chest Radiographs
    Rajaraman, Sivaramakrishnan
    Candemir, Sema
    Kim, Incheol
    Thoma, George
    Antani, Sameer
    APPLIED SCIENCES-BASEL, 2018, 8 (10):
  • [10] A framework to build accurate Convolutional Neural Network models for melanoma diagnosis
    Perez, Eduardo
    Ventura, Sebastian
    KNOWLEDGE-BASED SYSTEMS, 2023, 260