Ensembles of Convolutional Neural Network models for pediatric pneumonia diagnosis

被引:34
|
作者
Liz, Helena [1 ,6 ]
Sanchez-Montanes, Manuel [2 ]
Tagarro, Alfredo [3 ,4 ]
Dominguez-Rodriguez, Sara [4 ]
Dagan, Ron [5 ]
Camacho, David [1 ]
机构
[1] Univ Politecn Madrid, Comp Syst Engn Dept, Madrid, Spain
[2] Univ Autonoma Madrid, Comp Sci Dept, Madrid, Spain
[3] Univ Europea Madrid, Pediat Res Grp, Hosp Univ Infanta Sofia, Pediat Dept, Madrid, Spain
[4] Fdn Invest Biomed Hosp 12 Octubre, Pediat Res & Clin Trials Unit UPIC, Inst Invest Sanitaria Hosp 12 Octubre IMAS12, Madrid, Spain
[5] Ben Gurion Univ Negev, Fac Hlth Sci, Beer Sheva, Israel
[6] Univ Rey Juan Carlos, Dept Comp Sci, Madrid, Spain
关键词
Ensembles of Convolutional Neural; Networks; eXplainable Artificial Intelligence; Heatmaps; Pneumonia; Pediatrics; CHILDREN;
D O I
10.1016/j.future.2021.04.007
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Pneumonia is a lung infection that causes 15% of childhood mortality (under 5 years old), over 800,000 children under five every year, around 2,200 every day, all over the world. This pathology is mainly caused by viruses or bacteria. X-rays imaging analysis is one of the most used methods for pneumonia diagnosis. These clinical images can be analyzed using machine learning methods such as convolutional neural networks (CNN), which learn to extract critical features for the classification. However, the usability of these systems is limited in medicine due to the lack of interpretability, because of these models cannot be used to generate an understandable explanation (from a human-based perspective), about how they have reached those results. Another problem that difficults the impact of this technology is the limited amount of labeled data in many medicine domains. The main contributions of this work are two fold: the first one is the design of a new explainable artificial intelligence (XAI) technique based on combining the individual heatmaps obtained from each model in the ensemble. This allows to overcome the explainability and interpretability problems of the CNN "black boxes'', highlighting those areas of the image which are more relevant to generate the classification. The second one is the development of new ensemble deep learning models to classify chest X-rays that allow highly competitive results using small datasets for training. We tested our ensemble model using a small dataset of pediatric X-rays (950 samples of children between one month and 16 years old) with low quality and anatomical variability (which represents one of the biggest challenges addressed in this work). We also tested other strategies such as single CNNs trained from scratch and transfer learning using CheXNet. Our results show that our ensemble model clearly outperforms these strategies obtaining highly competitive results. Finally we confirmed the robustness of our approach using another pneumonia diagnosis dataset (Kermany et al., 2018). (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:220 / 233
页数:14
相关论文
共 50 条
  • [31] NEURAL NETWORK ENSEMBLES AS MODELS OF INTERDEPENDENCE IN COLLECTIVE BEHAVIOR
    ARTYUSHKIN, VF
    BELYAYEV, AV
    SANDLER, YM
    SERGEYEV, VM
    MATHEMATICAL SOCIAL SCIENCES, 1990, 19 (02) : 167 - 177
  • [32] Rotation-Equivariant Convolutional Neural Network Ensembles in Image Processing
    Gao, Liyao
    Li, Hongshan
    Lu, Zheying
    Lin, Guang
    UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, : 551 - 557
  • [33] Retinal Detachment Screening with Ensembles of Neural Network Models
    Masumoto, Hiroki
    Tabuchi, Hitoshi
    Adachi, Shoto
    Nakakura, Shunsuke
    Ohsugi, Hideharu
    Nagasato, Daisuke
    COMPUTER VISION - ACCV 2018 WORKSHOPS, 2019, 11367 : 251 - 260
  • [34] Pneumonia Detection from Pediatric Lung X-Ray Images with Convolutional Neural Network Method
    Demir, Yasin
    Bingol, Ozkan
    29TH IEEE CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS (SIU 2021), 2021,
  • [35] A new approach for Pneumonia diagnosis using Convolutional Neural Networks
    Alvarado, Leonardo
    Illaisaca, Pedro
    Hurtado, Remigio
    PROCEEDINGS OF THE XXII 2020 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC 2020), VOL 4, 2020,
  • [36] CT Image Analysis and Clinical Diagnosis of New Coronary Pneumonia Based on Improved Convolutional Neural Network
    Deng, Wu
    Yang, Bo
    Liu, Wei
    Song, Weiwei
    Gao, Yuan
    Xu, Jia
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021 (2021)
  • [37] Improving Pneumonia Diagnosis Accuracy via Systematic Convolutional Neural Network-Based Image Enhancement
    Wang, Ziqi
    Hall, Justin
    Haddad, Rami J.
    SOUTHEASTCON 2021, 2021, : 447 - 452
  • [38] AUTOMATIC DETECTION OF PNEUMONIA USING CONCATENATED CONVOLUTIONAL NEURAL NETWORK
    Al-Taani, Ahmad T.
    Al-Dagamseh, Ishraq T.
    JORDANIAN JOURNAL OF COMPUTERS AND INFORMATION TECHNOLOGY, 2023, 9 (02): : 118 - 136
  • [39] A Deep Convolutional Neural Network Based Framework for Pneumonia Detection
    Jamil, Sonain
    Abbas, Muhammad Sohail
    Fawad
    Zia, Muhammad Faisal
    Rahman, Muhib Ur
    2021 INTERNATIONAL CONFERENCE ON DIGITAL FUTURES AND TRANSFORMATIVE TECHNOLOGIES (ICODT2), 2021,
  • [40] A Pneumonia Detection Method Based on Improved Convolutional Neural Network
    Li, Xin
    Chen, Fan
    Hao, Haijiang
    Li, Mengting
    PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 488 - 493