NHBS-Net: A Feature Fusion Attention Network for Ultrasound Neonatal Hip Bone Segmentation

被引:29
|
作者
Liu, Ruhan [1 ]
Liu, Mengyao [2 ,3 ]
Sheng, Bin [1 ]
Li, Huating [4 ]
Li, Ping [5 ]
Song, Haitao [6 ]
Zhang, Ping [7 ,8 ]
Jiang, Lixin [2 ,3 ]
Shen, Dinggang [9 ,10 ,11 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Renji Hosp, Sch Med, Dept Ultrasound, Shanghai 200127, Peoples R China
[3] Shanghai Inst Ultrasound Med, Shanghai 200233, Peoples R China
[4] Shanghai Jiao Tong Univ, Affiliated Peoples Hosp 6, Shanghai 200233, Peoples R China
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[6] Shanghai Jiao Tong Univ, Artificial Intelligence Inst, Shanghai 200240, Peoples R China
[7] Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH 43210 USA
[8] Ohio State Univ, Dept Biomed Informat, Columbus, OH 43210 USA
[9] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[10] Shanghai United Imaging Intelligence Co Ltd, Dept Res & Dev, Shanghai 201807, Peoples R China
[11] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
基金
中国国家自然科学基金;
关键词
Image segmentation; Hip; Ultrasonic imaging; Bones; Feature extraction; Standards; Pediatrics; Neonatal hip bone segmentation; self-attention mechanism; medical image segmentation; IMAGE; DIAGNOSIS; DYSPLASIA; PROSTATE;
D O I
10.1109/TMI.2021.3087857
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Ultrasound is a widely used technology for diagnosing developmental dysplasia of the hip (DDH) because it does not use radiation. Due to its low cost and convenience, 2-D ultrasound is still the most common examination in DDH diagnosis. In clinical usage, the complexity of both ultrasound image standardization and measurement leads to a high error rate for sonographers. The automatic segmentation results of key structures in the hip joint can be used to develop a standard plane detection method that helps sonographers decrease the error rate. However, current automatic segmentation methods still face challenges in robustness and accuracy. Thus, we propose a neonatal hip bone segmentation network (NHBS-Net) for the first time for the segmentation of seven key structures. We design three improvements, an enhanced dual attention module, a two-class feature fusion module, and a coordinate convolution output head, to help segment different structures. Compared with current state-of-the-art networks, NHBS-Net gains outstanding performance accuracy and generalizability, as shown in the experiments. Additionally, image standardization is a common need in ultrasonography. The ability of segmentation-based standard plane detection is tested on a 50-image standard dataset. The experiments show that our method can help healthcare workers decrease their error rate from 6%-10% to 2%. In addition, the segmentation performance in another ultrasound dataset (fetal heart) demonstrates the ability of our network.
引用
收藏
页码:3446 / 3458
页数:13
相关论文
共 50 条
  • [41] ACCPG-Net: A skin lesion segmentation network with Adaptive Channel-Context-Aware Pyramid Attention and Global Feature Fusion?
    Zhang, Wenyu
    Lu, Fuxiang
    Zhao, Wei
    Hu, Yawen
    Su, Hongjing
    Yuan, Min
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 154
  • [42] WDFF-Net: Weighted Dual-Branch Feature Fusion Network for Polyp Segmentation With Object-Aware Attention Mechanism
    Cao, Jie
    Wang, Xin
    Qu, Zhiwei
    Zhuo, Li
    Li, Xiaoguang
    Zhang, Hui
    Yang, Yang
    Wei, Wei
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (07) : 4118 - 4131
  • [43] An Instance Segmentation Method for Insulator Defects Based on an Attention Mechanism and Feature Fusion Network
    Wu, Junpeng
    Deng, Qitong
    Xian, Ran
    Tao, Xinguang
    Zhou, Zhi
    APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [44] RAFNet: RGB-D attention feature fusion network for indoor semantic segmentation
    Yan, Xingchao
    Hou, Sujuan
    Karim, Awudu
    Jia, Weikuan
    DISPLAYS, 2021, 70
  • [45] Point cloud semantic segmentation based on local feature fusion and multilayer attention network
    Wen, Junjie
    Ma, Jie
    Zhao, Yuehua
    Nie, Tong
    Sun, Mengxuan
    Fan, Ziming
    IET COMPUTER VISION, 2024, 18 (03) : 381 - 392
  • [46] Multi-level feature fusion network combining attention mechanisms for polyp segmentation
    Liu, Junzhuo
    Chen, Qiaosong
    Zhang, Ye
    Wang, Zhixiang
    Deng, Xin
    Wang, Jin
    INFORMATION FUSION, 2024, 104
  • [47] A retinal vessel segmentation network with multiple-dimension attention and adaptive feature fusion
    Li J.
    Gao G.
    Yang L.
    Liu Y.
    Computers in Biology and Medicine, 2024, 172
  • [48] Dual attention enhancement feature fusion network for segmentation and quantitative analysis of paediatric echocardiography
    Guo, Libao
    Lei, Baiying
    Chen, Weiling
    Du, Jie
    Frangi, Alejandro F.
    Qin, Jing
    Zhao, Cheng
    Shi, Pengpeng
    Xia, Bei
    Wang, Tianfu
    MEDICAL IMAGE ANALYSIS, 2021, 71
  • [49] MFP-DeepLabv3+: A Multi-scale Feature Fusion and Parallel Attention Network for Enhanced Bone Metastasis Segmentation
    Gu, Hongwen
    Wang, Pengju
    Li, Yu
    Bao, Nan
    Wang, Hongwei
    Xie, Yanchun
    Xuan, Anwu
    Zhao, Yuanhang
    Yu, Hailong
    Ma, He
    TRAITEMENT DU SIGNAL, 2024, 41 (02) : 771 - 780
  • [50] EAAC-Net: An Efficient Adaptive Attention and Convolution Fusion Network for Skin Lesion Segmentation
    Fan, Chao
    Zhu, Zhentong
    Peng, Bincheng
    Xuan, Zhihui
    Zhu, Xinru
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2024, : 1120 - 1136