A hybrid attention deep learning network for refined segmentation of cracks from shield tunnel lining images

被引:17
|
作者
Zhao, Shuai [1 ]
Zhang, Guokai [2 ]
Zhang, Dongming [3 ]
Tan, Daoyuan [1 ]
Huang, Hongwei [3 ]
机构
[1] Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hong Kong 999077, Peoples R China
[2] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[3] Tongji Univ, Key Lab Geotech & Underground Engn, Minist Educ, Shanghai 200092, Peoples R China
关键词
Crack segmentation; Crack disjoint problem; U-net; Channel attention; Position attention; IDENTIFICATION; DEFECTS;
D O I
10.1016/j.jrmge.2023.02.025
中图分类号
P5 [地质学];
学科分类号
0709 ; 081803 ;
摘要
This research developed a hybrid position-channel network (named PCNet) through incorporating newly designed channel and position attention modules into U-Net to alleviate the crack discontinuity problem in channel and spatial dimensions. In PCNet, the U-Net is used as a baseline to extract informative spatial and channel-wise features from shield tunnel lining crack images. A channel and a position attention module are designed and embedded after each convolution layer of U-Net to model the feature interdependencies in channel and spatial dimensions. These attention modules can make the U-Net adaptively integrate local crack features with their global dependencies. Experiments were conducted utilizing the dataset based on the images from Shanghai metro shield tunnels. The results validate the effectiveness of the designed channel and position attention modules, since they can individually increase balanced accuracy (BA) by 11.25% and 12.95%, intersection over union (IoU) by 10.79% and 11.83%, and F1 score by 9.96% and 10.63%, respectively. In comparison with the state-of-the-art models (i.e. LinkNet, PSPNet, U-Net, PANet, and Mask R-CNN) on the testing dataset, the proposed PCNet out-performs others with an improvement of BA, IoU, and F-1 score owing to the implementation of the channel and position attention modules. These evaluation metrics indicate that the proposed PCNet presents refined crack segmentation with improved performance and is a practicable approach to segment shield tunnel lining cracks in field practice. (c) 2023 Institute of Rock and Soil Mechanics, Chinese Academy of Sciences. Production and hosting by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页码:3105 / 3117
页数:13
相关论文
共 50 条
  • [21] Deep Learning with Skip Connection Attention for Choroid Layer Segmentation in OCT Images
    Mao, Xiaoqian
    Zhao, Yitian
    Chen, Bang
    Ma, Yuhui
    Gu, Zaiwang
    Gu, Shenshen
    Yang, Jianlong
    Cheng, Jun
    Liu, Jiang
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 1641 - 1645
  • [22] A hybrid deep learning approach for gland segmentation in prostate histopathological images
    Salvi, Massimo
    Bosco, Martino
    Molinaro, Luca
    Gambella, Alessandro
    Papotti, Mauro
    Acharya, U. Rajendra
    Molinari, Filippo
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2021, 115
  • [23] Deep Learning for Automatic Segmentation of Hybrid Optoacoustic Ultrasound (OPUS) Images
    Lafci, Berkan
    Mercep, Elena
    Morscher, Stefan
    Dean-Ben, Xose Luis
    Razansky, Daniel
    IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2021, 68 (03) : 688 - 696
  • [24] Efficient and Refined Deep Convolutional Features Network for the Crack Segmentation of Solar Cell Electroluminescence Images
    Wang, Chuhan
    Chen, Haiyong
    Zhao, Shenshen
    Rahman, Muhammad Rameez Ur
    IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2022, 35 (04) : 610 - 619
  • [25] Real-Time Semantic Segmentation of Remote Sensing Images Based on Bilateral Attention Refined Network
    Cai, Jiali
    Liu, Chunjuan
    Yan, Haowen
    Wu, Xiaosuo
    Lu, Wanzhen
    Wang, Xiaoyu
    Sang, Changlin
    IEEE ACCESS, 2021, 9 : 28349 - 28360
  • [26] A Hybrid deep learning model for effective segmentation and classification of lung nodules from CT images
    Murugesan, Malathi
    Kaliannan, Kalaiselvi
    Balraj, Shankarlal
    Singaram, Kokila
    Kaliannan, Thenmalar
    Albert, Johny Renoald
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (03) : 2667 - 2679
  • [27] HYBRID APPROACH FOR AUTOMATIC SEGMENTATION OF FETAL ABDOMEN FROM ULTRASOUND IMAGES USING DEEP LEARNING
    Ravishankar, Hariharan
    Prabhu, Sahana M.
    Vaidya, Vivek
    Singhal, Nitin
    2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, : 779 - 782
  • [28] Dual attention-based deep learning network for multi-class object semantic segmentation of tunnel point clouds
    Ji, Ankang
    Zhang, Limao
    Fan, Hongqin
    Xue, Xiaolong
    Dou, Yudan
    AUTOMATION IN CONSTRUCTION, 2023, 156
  • [29] VISN: virus instance segmentation network for TEM images using deep attention transformer
    Xiao, Chi
    Wang, Jun
    Yang, Shenrong
    Heng, Minxin
    Su, Junyi
    Xiao, Hao
    Song, Jingdong
    Li, Weifu
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (06)
  • [30] Hybrid Deep Neural Network for Brachial Plexus Nerve Segmentation in Ultrasound Images
    van Boxtel, Juul
    Vousten, Vincent
    Pluim, Josien
    Rad, Nastaran Mohammadian
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 1246 - 1250