A 3D boundary-guided hybrid network with convolutions and Transformers for lung tumor segmentation in CT images

被引:0
|
作者
Liu, Hong [1 ]
Zhuang, Yuzhou [1 ]
Song, Enmin [1 ]
Liao, Yongde [2 ]
Ye, Guanchao [2 ]
Yang, Fan [3 ]
Xu, Xiangyang [1 ]
Xiao, Xvhao [4 ]
Hung, Chih-Cheng [5 ]
机构
[1] Center for Biomedical Imaging and Bioinformatics, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan,430074, China
[2] Department of Thoracic Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[3] Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[4] Research Institute of High-Tech, Shaanxi, Xi'an,710025, China
[5] Center for Machine Vision and Security Research, Kennesaw State University, Marietta,MA,30060, United States
关键词
Biological organs - Computerized tomography - Decoding - Diagnosis - Image segmentation - Tumors;
D O I
10.1016/j.compbiomed.2024.109009
中图分类号
学科分类号
摘要
—Accurate lung tumor segmentation from Computed Tomography (CT) scans is crucial for lung cancer diagnosis. Since the 2D methods lack the volumetric information of lung CT images, 3D convolution-based and Transformer-based methods have recently been applied in lung tumor segmentation tasks using CT imaging. However, most existing 3D methods cannot effectively collaborate the local patterns learned by convolutions with the global dependencies captured by Transformers, and widely ignore the important boundary information of lung tumors. To tackle these problems, we propose a 3D boundary-guided hybrid network using convolutions and Transformers for lung tumor segmentation, named BGHNet. In BGHNet, we first propose the Hybrid Local-Global Context Aggregation (HLGCA) module with parallel convolution and Transformer branches in the encoding phase. To aggregate local and global contexts in each branch of the HLGCA module, we not only design the Volumetric Cross-Stripe Window Transformer (VCSwin-Transformer) to build the Transformer branch with local inductive biases and large receptive fields, but also design the Volumetric Pyramid Convolution with transformer-based extensions (VPConvNeXt) to build the convolution branch with multi-scale global information. Then, we present a Boundary-Guided Feature Refinement (BGFR) module in the decoding phase, which explicitly leverages the boundary information to refine multi-stage decoding features for better performance. Extensive experiments were conducted on two lung tumor segmentation datasets, including a private dataset (HUST-Lung) and a public benchmark dataset (MSD-Lung). Results show that BGHNet outperforms other state-of-the-art 2D or 3D methods in our experiments, and it exhibits superior generalization performance in both non-contrast and contrast-enhanced CT scans. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [31] Neural network analysis applied to tumor segmentation on 3D breast ultrasound images
    Huang, Sheng-Fang
    Chen, Yen-Ching
    Moon, Woo Kyung
    2008 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1-4, 2008, : 1303 - +
  • [32] Modality-Specific Segmentation Network for Lung Tumor Segmentation in PET-CT Images
    Xiang, Dehui
    Zhang, Bin
    Lu, Yuxuan
    Deng, Shengming
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (03) : 1237 - 1248
  • [33] Prostate boundary segmentation from 3D ultrasound images
    Hu, N
    Downey, DB
    Fenster, A
    Ladak, HM
    MEDICAL PHYSICS, 2003, 30 (07) : 1648 - 1659
  • [34] Supervised recursive segmentation of volumetric CT images for 3D reconstruction of lung and vessel tree
    Li, Xuanping
    Wang, Xue
    Dai, Yixiang
    Zhang, Pengbo
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2015, 122 (03) : 316 - 329
  • [35] Central Medialness Adaptive Strategy for 3D Lung Nodule Segmentation in Thoracic CT Images
    Goncalves, Luis
    Novo, Jorge
    Campilho, Aurelio
    IMAGE ANALYSIS AND RECOGNITION (ICIAR 2016), 2016, 9730 : 583 - 590
  • [36] 3D Segmentation and Image Annotation for Quantitative Diagnosis in Lung CT Images with Pulmonary Lesions
    Li, Suo
    Zhu, Yanjie
    Sun, Jianyong
    Zhang, Jianguo
    MEDICAL IMAGING 2013: ADVANCED PACS-BASED IMAGING INFORMATICS AND THERAPEUTIC APPLICATIONS, 2013, 8674
  • [37] Automatic segmentation of the orbital bone in 3D maxillofacial CT images with Double-Bone-Segmentation Network
    Lee, Soyoung
    Lee, Min Jin
    Hong, Helen
    Shim, Kyu Won
    Park, Seongeun
    INTERNATIONAL FORUM ON MEDICAL IMAGING IN ASIA 2019, 2019, 11050
  • [38] Liver Segmentation from 3D Abdominal CT Images
    Pham The Bao
    Tran Hong Tai
    Duong, Viet-Hang
    Wang, Jia-Ching
    2015 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2015, : 342 - 343
  • [39] Segmentation of pelvis and femur from 3D CT images
    Zoroofi, RA
    Sasama, T
    Sugano, N
    Nishii, T
    Sato, Y
    Yonenobu, K
    Yoshikawa, H
    Tamura, S
    Ochi, T
    CARS 2001: COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2001, 1230 : 1108 - 1108
  • [40] Automated segmentation of liver from 3D CT images
    Foruzan, Amir H.
    Zoroofi, Reza A.
    Sato, Yoshinobu
    Hori, Masatoshi
    Murakami, Takamichi
    Nakamura, Hironobu
    Tamura, Shinichi
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2006, 1 : 71 - 73