An improved 3-D attention CNN with hybrid loss and feature fusion for pulmonary nodule classification

被引:9
|
作者
Huang, Yao-Sian [1 ]
Wang, Teh-Chen [2 ]
Huang, Sheng-Zhi [3 ]
Zhang, Jun [4 ]
Chen, Hsin-Ming [5 ]
Chang, Yeun-Chung [5 ,6 ]
Chang, Ruey-Fen [3 ,4 ,7 ,8 ,9 ,10 ]
机构
[1] Natl Changhua Univ Educ, Dept Comp Sci & Informat Engn, Changhua, Taiwan
[2] Taipei City Hosp, Yangming Branch, Dept Med Imaging, Taipei, Taiwan
[3] Natl Taiwan Univ, Grad Inst Network & Multimedia, Taipei, Taiwan
[4] Natl Taiwan Univ, Grad Inst Biomed Elect & Bioinformat, Taipei, Taiwan
[5] Natl Taiwan Univ, Hosp Hsin Chu Branch, Dept Med Imaging, Hsinchu, Taiwan
[6] Natl Taiwan Univ Hosp, Dept Med Imaging, Taipei 10617, Taiwan
[7] Natl Taiwan Univ, Coll Med, Taipei 10617, Taiwan
[8] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 10617, Taiwan
[9] MOST Joint Res Ctr AI Technol, Taipei, Taiwan
[10] All Vista Healthcare, Taipei, Taiwan
关键词
Lung nodules; Computer -aided diagnosis; Residual network; Attention mechanism; Feature pyramid network; Hybrid loss; LUNG NODULES;
D O I
10.1016/j.cmpb.2022.107278
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Lung cancer has the highest cancer-related mortality worldwide, and lung nodule usually presents with no symptom. Low-dose computed tomography (LDCT) was an important tool for lung cancer detection and diagnosis. It provided a complete three-dimensional (3-D) chest image with a high resolution.Recently, convolutional neural network (CNN) had flourished and been proven the CNN -based computer-aided diagnosis (CADx) system could extract the features and help radiologists to make a preliminary diagnosis. Therefore, a 3-D ResNeXt-based CADx system was proposed to assist radiologists for diagnosis in this study.Methods: The proposed CADx system consists of image preprocessing and a 3-D CNN-based classifica-tion model for pulmonary nodule classification. First, the image preprocessing was executed to generate the normalized volumn of interest (VOI) only including nodule information and a few surrounding tis-sues. Then, the extracted VOI was forwarded to the 3-D nodule classification model. In the classification model, the RestNext was employed as the backbone and the attention scheme was embedded to focus on the important features. Moreover, a multi-level feature fusion network incorporating feature information of different scales was used to enhance the prediction accuracy of small malignant nodules. Finally, a hybrid loss based on channel optimization which make the network learn more detailed information was empolyed to replace a binary cross-entropy (BCE) loss.Results: In this research, there were a total of 880 low-dose CT images including 440 benign and 440 malignant nodules from the American National Lung Screening Trial (NLST) for system evaluation. The results showed that our system could achieve the accuracy of 85.3%, the sensitivity of 86.8%, the speci-ficity of 83.9%, and the area-under-curve (AUC) value was 0.9042. It was confirmed that the designed system had a good diagnostic ability.Conclusion: In this study, a CADx composed of the image preprocessing and a 3-D nodule classification model with attention scheme, feature fusion, and hybrid loss was proposed for pulmonary nodule clas-sification in LDCT. The results indicated that the proposed CADx system had potential for achieving high performance in classifying lung nodules as benign and malignant. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] One-stage pulmonary nodule detection using 3-D DCNN with feature fusion and attention mechanism in CT image
    Huang, Yao-Sian
    Chou, Ping-Ru
    Chen, Hsin-Ming
    Chang, Yeun-Chung
    Chang, Ruey-Feng
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 220
  • [2] A Hybrid CNN Feature Model for Pulmonary Nodule Differentiation Task
    Zhao, Tingting
    Wang, Huafeng
    Li, Lihong
    Qi, Yifang
    Gao, Haoqi
    Han, FangFang
    Liang, Zhengrong
    Qi, Yanmin
    Cao, Yuan
    IMAGING FOR PATIENT-CUSTOMIZED SIMULATIONS AND SYSTEMS FOR POINT-OF-CARE ULTRASOUND, 2017, 10549 : 19 - 26
  • [3] Attention-Guided Feature Extraction and Multiscale Feature Fusion 3D ResNet for Automated Pulmonary Nodule Detection
    Zhang, Guanglu
    Zhang, Hongjun
    Yao, Yuhua
    Shen, Qiuhui
    IEEE ACCESS, 2022, 10 : 61530 - 61543
  • [4] A Hybrid 3D-2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification
    Wen, Xiaoyan
    Yu, Xiaodong
    Wang, Yufan
    Yang, Cuiping
    Sun, Yu
    REMOTE SENSING, 2023, 15 (18)
  • [5] A hybrid CNN feature model for pulmonary nodule malignancy risk differentiation
    Wang, Huafeng
    Zhao, Tingting
    Li, Lihong Connie
    Pan, Haixia
    Liu, Wanquan
    Gao, Haoqi
    Han, Fangfang
    Wang, Yuehai
    Qi, Yifan
    Liang, Zhengrong
    JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY, 2018, 26 (02) : 171 - 187
  • [6] Pulmonary Nodule Detection Based on ISODATA-Improved Faster RCNN and 3D-CNN with Focal Loss
    Tong, Chao
    Liang, Baoyu
    Zhang, Mengze
    Chen, Rongshan
    Sangaiah, Arun Kumar
    Zheng, Zhigao
    Wan, Tao
    Yue, Chenyang
    Yang, Xinyi
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)
  • [7] Multiple 3-D Feature Fusion Framework for Hyperspectral Image Classification
    Zhu, Jiasong
    Hu, Jie
    Jia, Sen
    Jia, Xiuping
    Li, Qingquan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (04): : 1873 - 1886
  • [8] Pulmonary nodule classification based on nodule retrieval from 3-D thoracic CT image database
    Kawata, Y
    Niki, N
    Ohmatsu, H
    Kusumoto, M
    Kakinuma, R
    Yamada, K
    Mori, K
    Nishiyama, H
    Eguchi, K
    Kaneko, M
    Moriyama, N
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2004, PT 2, PROCEEDINGS, 2004, 3217 : 838 - 846
  • [9] Deep Collaborative Attention Network for Hyperspectral Image Classification by Combining 2-D CNN and 3-D CNN
    Guo, Hao
    Liu, Jianjun
    Yang, Jinlong
    Xiao, Zhiyong
    Wu, Zebin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 4789 - 4802
  • [10] Hierarchical CNN Classification of Hyperspectral Images Based on 3-D Attention Soft Augmentation
    Miao, Xinyuan
    Zhang, Ye
    Zhang, Junping
    Liang, Xuejian
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 4217 - 4233