NHBS-Net: A Feature Fusion Attention Network for Ultrasound Neonatal Hip Bone Segmentation

被引:29
|
作者
Liu, Ruhan [1 ]
Liu, Mengyao [2 ,3 ]
Sheng, Bin [1 ]
Li, Huating [4 ]
Li, Ping [5 ]
Song, Haitao [6 ]
Zhang, Ping [7 ,8 ]
Jiang, Lixin [2 ,3 ]
Shen, Dinggang [9 ,10 ,11 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Renji Hosp, Sch Med, Dept Ultrasound, Shanghai 200127, Peoples R China
[3] Shanghai Inst Ultrasound Med, Shanghai 200233, Peoples R China
[4] Shanghai Jiao Tong Univ, Affiliated Peoples Hosp 6, Shanghai 200233, Peoples R China
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[6] Shanghai Jiao Tong Univ, Artificial Intelligence Inst, Shanghai 200240, Peoples R China
[7] Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH 43210 USA
[8] Ohio State Univ, Dept Biomed Informat, Columbus, OH 43210 USA
[9] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[10] Shanghai United Imaging Intelligence Co Ltd, Dept Res & Dev, Shanghai 201807, Peoples R China
[11] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
基金
中国国家自然科学基金;
关键词
Image segmentation; Hip; Ultrasonic imaging; Bones; Feature extraction; Standards; Pediatrics; Neonatal hip bone segmentation; self-attention mechanism; medical image segmentation; IMAGE; DIAGNOSIS; DYSPLASIA; PROSTATE;
D O I
10.1109/TMI.2021.3087857
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Ultrasound is a widely used technology for diagnosing developmental dysplasia of the hip (DDH) because it does not use radiation. Due to its low cost and convenience, 2-D ultrasound is still the most common examination in DDH diagnosis. In clinical usage, the complexity of both ultrasound image standardization and measurement leads to a high error rate for sonographers. The automatic segmentation results of key structures in the hip joint can be used to develop a standard plane detection method that helps sonographers decrease the error rate. However, current automatic segmentation methods still face challenges in robustness and accuracy. Thus, we propose a neonatal hip bone segmentation network (NHBS-Net) for the first time for the segmentation of seven key structures. We design three improvements, an enhanced dual attention module, a two-class feature fusion module, and a coordinate convolution output head, to help segment different structures. Compared with current state-of-the-art networks, NHBS-Net gains outstanding performance accuracy and generalizability, as shown in the experiments. Additionally, image standardization is a common need in ultrasonography. The ability of segmentation-based standard plane detection is tested on a 50-image standard dataset. The experiments show that our method can help healthcare workers decrease their error rate from 6%-10% to 2%. In addition, the segmentation performance in another ultrasound dataset (fetal heart) demonstrates the ability of our network.
引用
收藏
页码:3446 / 3458
页数:13
相关论文
共 50 条
  • [21] FPF-Net: feature propagation and fusion based on attention mechanism for pancreas segmentation
    Chen, Haipeng
    Liu, Yunjie
    Shi, Zenan
    MULTIMEDIA SYSTEMS, 2023, 29 (02) : 525 - 538
  • [22] FPF-Net: feature propagation and fusion based on attention mechanism for pancreas segmentation
    Haipeng Chen
    Yunjie Liu
    Zenan Shi
    Multimedia Systems, 2023, 29 : 525 - 538
  • [23] SAF-Net:Self Attention Fusion Network for Retinal Vessel Segmentation
    Liu, Na
    Wang, Guoqiang
    Computer Engineering and Applications, 2023, 59 (14) : 217 - 223
  • [24] FFA-Net: Feature Fusion Attention Network for Single Image Dehazing
    Qin, Xu
    Wang, Zhilin
    Bai, Yuanchao
    Xie, Xiaodong
    Jia, Huizhu
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11908 - 11915
  • [25] CFFANet: category feature fusion and attention mechanism network for retinal vessel segmentation
    Chen, Qiyu
    Wang, Jianming
    Yin, Jiting
    Yang, Zizhong
    MULTIMEDIA SYSTEMS, 2024, 30 (06)
  • [26] Multi-scale feature fusion network with local attention for lung segmentation
    Xie, Yinghua
    Zhou, Yuntong
    Wang, Chen
    Ma, Yanshan
    Yang, Ming
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 119
  • [27] Attention Guided Multi Scale Feature Fusion Network for Automatic Prostate Segmentation
    Li, Yuchun
    Huang, Mengxing
    Zhang, Yu
    Bai, Zhiming
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (02): : 1649 - 1668
  • [28] Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation
    Dong, Kaiqi
    Hu, Peijun
    Zhu, Yan
    Tian, Yu
    Li, Xiang
    Zhou, Tianshu
    Bai, Xueli
    Liang, Tingbo
    Li, Jingsong
    MEDICAL PHYSICS, 2024, 51 (12) : 8999 - 9016
  • [29] AN ATTENTION MECHANISM AND MULTI-FEATURE FUSION NETWORK FOR MEDICAL IMAGE SEGMENTATION
    Ren, Xianxiang
    Liang, Hu
    Zhao, Shengrong
    PROCEEDINGS OF THE ROMANIAN ACADEMY SERIES A-MATHEMATICS PHYSICS TECHNICAL SCIENCES INFORMATION SCIENCE, 2023, 24 (02): : 191 - 200
  • [30] Multilayer feature fusion and attention-based network for crops and weeds segmentation
    Haoyu Wang
    Haiyu Song
    Haiyan Wu
    Zhiqiang Zhang
    Shengchun Deng
    Xiaoqing Feng
    Yanhong Chen
    Journal of Plant Diseases and Protection, 2022, 129 : 1475 - 1489