SGNet: Structure-Aware Graph-Based Network for Airway Semantic Segmentation

被引:13
|
作者
Tan, Zimeng [1 ,2 ]
Feng, Jianjiang [1 ,2 ]
Zhou, Jie [1 ,2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[2] Beijing Natl Res Ctr Informat Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Airway semantic segmentation; Graph convolutional network; Structural prior; TREE;
D O I
10.1007/978-3-030-87193-2_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Airway semantic segmentation, which refers to segmenting airway from background and dividing it into anatomical segments, provides clinically valuable information for lung lobe analysis, pulmonary lesion localization, and comparison between different patients. It is technically challenging due to the complicated tree-like structure, individual variations, and severe class imbalance. We propose a structure-aware graph-based network (SGNet) for airway semantic segmentation directly from chest CT scans. The proposed framework consists of a feature extractor combining a multi-task U-Net with a structure-aware GCN, and an inference module comprised of two convolutional layers. The multi-task U-Net is trained to regress bifurcation landmark heatmaps, binary and semantic segmentation maps simultaneously, providing initial predictions for graph construction. By introducing irregular edges connecting voxels with the sampled points around corresponding bifurcation landmarks, the two-layer GCN incorporates the structural prior explicitly. Experiments on both public and private datasets demonstrate that the SGNet achieves superior and robust performance, even on subjects affected by severe pulmonary diseases.
引用
收藏
页码:153 / 163
页数:11
相关论文
共 50 条
  • [1] Graph-Based Semantic Segmentation
    Balaska, Vasiliki
    Bampis, Loukas
    Gasteratos, Antonios
    ADVANCES IN SERVICE AND INDUSTRIAL ROBOTICS, RAAD 2018, 2019, 67 : 572 - 579
  • [2] GATE FUNCTION BASED STRUCTURE-AWARE CONVOLUTION FOR SCENE SEMANTIC SEGMENTATION
    Cheng, Zhou
    Li, Jiancheng
    Yuan, Chun
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 253 - 258
  • [3] SGNet: a fast and accurate semantic segmentation network based on semantic guidance
    Li, Hengyu
    Han, Shuang
    Liu, Jingyi
    Wang, Hongzhou
    Wang, Yueying
    Xie, Shaorong
    ADVANCED ROBOTICS, 2023, 37 (20) : 1301 - 1317
  • [4] Depth Estimation From Light Field Using Graph-Based Structure-Aware Analysis
    Zhang, Yuchen
    Dai, Wenrui
    Xu, Mingxing
    Zou, Junni
    Zhang, Xiaopeng
    Xiong, Hongkai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (11) : 4269 - 4283
  • [5] STRUCTURE-AWARE GRAPH CONSTRUCTION FOR POINT CLOUD SEGMENTATION WITH GRAPH CONVOLUTIONAL NETWORKS
    Wang, Shanghong
    Dai, Wenrui
    Xu, Mingxing
    Li, Chenglin
    Zou, Junni
    Xiong, Hongkai
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [6] Relation Structure-Aware Heterogeneous Graph Neural Network
    Zhu, Shichao
    Zhou, Chuan
    Pan, Shirui
    Zhu, Xingquan
    Wang, Bin
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1534 - 1539
  • [7] Learning structure-aware semantic segmentation with image-level supervision
    Liu, Jiawei
    Zhang, Jing
    Hong, Yicong
    Barnes, Nick
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [8] Robust Structure-aware Graph-based Semi-supervised Learning: Batch and Recursive Processing
    Chen, Xu
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2024, 15 (04)
  • [9] Structure-aware enhancement of imaging mass spectrometry data for semantic segmentation
    Liang, Luming
    Zhang, Zhi-min
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 171 : 259 - 265
  • [10] A Structure-Aware Relation Network for Thoracic Diseases Detection and Segmentation
    Lian, Jie
    Liu, Jingyu
    Zhang, Shu
    Gao, Kai
    Liu, Xiaoqing
    Zhang, Dingwen
    Yu, Yizhou
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (08) : 2042 - 2052