An improved 3-D attention CNN with hybrid loss and feature fusion for pulmonary nodule classification

被引:9
|
作者
Huang, Yao-Sian [1 ]
Wang, Teh-Chen [2 ]
Huang, Sheng-Zhi [3 ]
Zhang, Jun [4 ]
Chen, Hsin-Ming [5 ]
Chang, Yeun-Chung [5 ,6 ]
Chang, Ruey-Fen [3 ,4 ,7 ,8 ,9 ,10 ]
机构
[1] Natl Changhua Univ Educ, Dept Comp Sci & Informat Engn, Changhua, Taiwan
[2] Taipei City Hosp, Yangming Branch, Dept Med Imaging, Taipei, Taiwan
[3] Natl Taiwan Univ, Grad Inst Network & Multimedia, Taipei, Taiwan
[4] Natl Taiwan Univ, Grad Inst Biomed Elect & Bioinformat, Taipei, Taiwan
[5] Natl Taiwan Univ, Hosp Hsin Chu Branch, Dept Med Imaging, Hsinchu, Taiwan
[6] Natl Taiwan Univ Hosp, Dept Med Imaging, Taipei 10617, Taiwan
[7] Natl Taiwan Univ, Coll Med, Taipei 10617, Taiwan
[8] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 10617, Taiwan
[9] MOST Joint Res Ctr AI Technol, Taipei, Taiwan
[10] All Vista Healthcare, Taipei, Taiwan
关键词
Lung nodules; Computer -aided diagnosis; Residual network; Attention mechanism; Feature pyramid network; Hybrid loss; LUNG NODULES;
D O I
10.1016/j.cmpb.2022.107278
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Lung cancer has the highest cancer-related mortality worldwide, and lung nodule usually presents with no symptom. Low-dose computed tomography (LDCT) was an important tool for lung cancer detection and diagnosis. It provided a complete three-dimensional (3-D) chest image with a high resolution.Recently, convolutional neural network (CNN) had flourished and been proven the CNN -based computer-aided diagnosis (CADx) system could extract the features and help radiologists to make a preliminary diagnosis. Therefore, a 3-D ResNeXt-based CADx system was proposed to assist radiologists for diagnosis in this study.Methods: The proposed CADx system consists of image preprocessing and a 3-D CNN-based classifica-tion model for pulmonary nodule classification. First, the image preprocessing was executed to generate the normalized volumn of interest (VOI) only including nodule information and a few surrounding tis-sues. Then, the extracted VOI was forwarded to the 3-D nodule classification model. In the classification model, the RestNext was employed as the backbone and the attention scheme was embedded to focus on the important features. Moreover, a multi-level feature fusion network incorporating feature information of different scales was used to enhance the prediction accuracy of small malignant nodules. Finally, a hybrid loss based on channel optimization which make the network learn more detailed information was empolyed to replace a binary cross-entropy (BCE) loss.Results: In this research, there were a total of 880 low-dose CT images including 440 benign and 440 malignant nodules from the American National Lung Screening Trial (NLST) for system evaluation. The results showed that our system could achieve the accuracy of 85.3%, the sensitivity of 86.8%, the speci-ficity of 83.9%, and the area-under-curve (AUC) value was 0.9042. It was confirmed that the designed system had a good diagnostic ability.Conclusion: In this study, a CADx composed of the image preprocessing and a 3-D nodule classification model with attention scheme, feature fusion, and hybrid loss was proposed for pulmonary nodule clas-sification in LDCT. The results indicated that the proposed CADx system had potential for achieving high performance in classifying lung nodules as benign and malignant. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] An Efficient Hyperspectral Image Classification Method Using Deep Fusion of 3-D Discrete Wavelet Transform and CNN
    Xu, Jingran
    Zhao, Jiankang
    Fu, Yuchao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [42] A feature fusion-based attention graph convolutional network for 3D classification and segmentation
    Yang, Chengyong
    Wang, Jie
    Wei, Shiwei
    Yu, Xiukang
    ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (12): : 7365 - 7384
  • [43] Study on Identification Method of Pulmonary Nodules: Improved Random Walk Pulmonary Parenchyma Segmentation and Fusion Multi-Feature VGG16 Nodule Classification
    Zhang, Yanrong
    Meng, Lingyue
    FRONTIERS IN ONCOLOGY, 2022, 12
  • [44] Pulmonary Nodule Detection Using 3-D Residual U-Net Oriented Context-Guided Attention and Multi-Branch Classification Network
    Yuan, Haiying
    Wu, Yanrui
    Cheng, Junpeng
    Fan, Zhongwei
    Zeng, Zhiyong
    IEEE ACCESS, 2022, 10 : 82 - 98
  • [45] An improved CNN based on attention mechanism with multi-domain feature fusion for bearing fault diagnosis
    Yu, Mingzhu
    Liu, Heli
    Wang, Rengen
    Kong, Xiangwei
    Hu, Zhiyong
    Li, Xueyi
    2021 IEEE INTERNATIONAL CONFERENCE ON PROGNOSTICS AND HEALTH MANAGEMENT (ICPHM), 2021,
  • [46] Multimodal EEG and Eye Tracking Feature Fusion Approaches for Attention Classification in Hybrid BCIs
    Vortmann, Lisa-Marie
    Ceh, Simon
    Putze, Felix
    FRONTIERS IN COMPUTER SCIENCE, 2022, 4
  • [47] Adjacent-level Feature Cross-Fusion with 3-D CNN for Remote Sensing Image Change Detection
    Ye, Yuanxin
    Wang, Mengmeng
    Zhou, Liang
    Lei, Guangyang
    Fan, Jianwei
    Qin, Yao
    arXiv, 2023,
  • [48] Hypergraph based feature fusion for 3-D object retrieval
    Wang, Fanglin
    Peng, Jialiang
    Li, Yongjie
    NEUROCOMPUTING, 2015, 151 : 612 - 619
  • [49] Adjacent-Level Feature Cross-Fusion With 3-D CNN for Remote Sensing Image Change Detection
    Ye, Yuanxin
    Wang, Mengmeng
    Zhou, Liang
    Lei, Guangyang
    Fan, Jianwei
    Qin, Yao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [50] 3-D Shearlet Transform Based Feature Extraction for Improved Joint Sparse Representation HSI Classification
    Zaouali, Mariem
    Bouzidi, Sonia
    Zagrouba, Ezzeddine
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (04) : 1306 - 1314